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(54) IMAGE ENCODING DEVICE, IMAGE ENCODING METHOD, IMAGE DECODING DEVICE AND 
IMAGE DECODING METHOD 



(57) A coded bit stream 30 generated on a coding 
side consists of a VO header 30a, a VOL header 30b. a 
GOV header 30c, a VOP header 30d and VOP data 
30e. and the VOL header 30b multiplexes an object 
intra-coded indicator signal 7' indicating whether all the 
VOP data 30e contained in a VOL or GOV are intra 
coded or not. This enables a decoding side to recognize 

FTG.S 



whether all the VOP data 30e contained in the VOL or 
GOV in the coded bit stream 30 are intra coded or not by 
only analyzing the object intra-coded indicator signal 7. 
This can facilitate such processings as frame skip con- 
trol or random access of the VOPs. 
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SSL bit J^Z^^^ '° ^" ^'"9 ^P^^*"^ ^ '™9e «^ing method for generating a 

^5 J? f ^Jf^'I^^ ^" '"^9^ ^^^"^'"9 ^P^at^s and an image decoding method for r«S I 

coded brt stream and for decoding an image signal contained in the coded bit stream srSv^^ZSlJ^t^^^rl 
cod,ng apparatus and an image coding method acco«*ng to MPEG-4 for ocSr^l^^ZL^t mZZS 
stream generated by coding images on an object by ofcgect basis. "ewxiing a coaea oit 
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BK ^"!'^"*i°"^'y' 3s a -method of coding or decoding an Image signal. MPEG-4 (Movina Picture Exoens 

fSe an^shrjfnlm A^T'*^ ^ "^^"9 picture sequence as a collection of moving image objects 

SiS ^l^^^^ and carries out coding and decoding based on individual moving image obieiT 
\^ ^ '^^'^ according to the MPEG-4 standard ' 

! '^'"^ '"°'"*"9 « ti-"^ referred to as a Video Object (VO) comoo- 

r ^/^^^'^'"^ *° ' '^^'^ (VOL), components of the VOL are eaScaMS a^X 

ofVideo Objert P ane (GOV), and the image data that represents the momentary state of the GOV ani fonS a 

inl v«l^ f ' ^° corresponds to individual lalk^ aS^httec^^LiS 

esoS'TnL^r^Op'trL m ^'j' ' I!"' '"^^"'^ *'«^ « P-^-- temp?rai?5SS 

resolution, and the VOP is the momentary image data of the VOLs (corresponding to frames) The GOV i«L a riata^n^ 
ture^n^stingofapluralityofVO 

10006] Fig 2 shows a concrete example of the VOPs. Fig. 2 shows two VOPs. (V0P1 represents a man and VOP? 
r^e^nts a ^cture on a wall). Each VOP consists of texture data representing <Llor gSSi SsTrS 

TIL^ V ^"""^"^'^ horizontal and vertical directions with respect to the luminance signal) The aeome^ 
ric data s binary matrix data that assigns "1 " to the inside of the VOP and "0" to the outside JSLflSha^ the ™ 

l^.r.iJ^J^nT^'^ based on the VOPs, a conventional frame image is obtained by Diaclna 

the plurality of VOPs in position in a picture. If the shape of the VOP is rectangular and time-inv^iart *e \^P bS« 

?ru:s'ofTh:^o%or^^^^^^ 

string .hat canbelnterjxetedun^u^y,fc.i^^^^ 

so SJteSwSS^^r^ft^^^^ 

IS ^JH^- ^JH^'!^ 1^'^- *^ ''"age coding apparatus and image decoding apparatus can 

STSov nr iL I'f "fi' t"^ ^ a result. although the coding sidS codes the entire VOP n such unS i " 

trolfordecimating image signal tobecoded in accordance With theloadofadecoder.t^.ed^^^^ 
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the desired VOP to be accessed or the VOP to be decoded in the frame skip control until it recognizes the predictive 
structure and time information of the coded bit stream by analyzing the coded data of the all the VOPs. This presents a 
problem of making the decoding processing difficult and prolonging the decoding. 

[001 1 ] The present invention is implemented to solve the foregoing problem. Therefore, it is an object of the present 
5 invention to provide an image coding apparatus, image coding method, image decoding apparatus and image decoding 
method capable of enabling, when all the images contained in a moving picture sequence undergo only the intra coding, 
the image decoding apparatus to carry out access to the very image at a desired time, so as to facilitate smooth decod- 
ing processing like the frame skip control, tha-eby shortening the decoding processing. 

[0012] In particular, an object of the present invention is to provide an image coding apparatus. Image coding 
10 method, image decoding apparatus and image decoding method capable of enabling the image decoding apparatus to 
carry out access to the very image at a desired time, and to facilitate smooth decoding processing like the frame skip 
control, thereby shortening the decoding processing, when the coding side codes all the VOPs contained in the units 
like VOL or GOV of the object using only the Intra coding according to the MPEG'4 standard that decodes the images 
consisting of a plurality of objects on an object by object basis. 

IS 

DISCLOSURE OF THE INVENTION 

[0013] The image coding apparatus or image coding method according to the present invention encodes images 
contained in a moving picture sequence in accordance with intra-coding instruction information instructing whether all 
20 the images contained in the moving picture sequence are to be intra coded or not; and multiplexes an encoded image 
coded signal with intra-coded indicator information Indicating whether all the images contained in the moving picture 
sequence are intra coded or not. 

[0014] This enables the decoding side to decide as to whether all the image data contained in the moving picture 
sequence undergo the intra coding or not without decoding the headers or overheads of tiie individual image data con- 
25 stituting the moving picture sequence. This offers an advantage of being able to generate tfie coded bit stream that ena- 
bles the decoding side to carry out decoding with sinply varying display rate or decoding rate, and to make random 
access to the image at a desired time with ease. 

[001 5] The image decoding apparatus or image decoding method according to the present invention analyzes, in a 
coded bit stream, intra-coded indicator information indicating whetiier all images contained in a moving picture 
30 sequence are intra coded or not; and decodes the images contained in the moving picture sequence in accordance witii 
the intra-coded indicator information. 

[001 6] This enables tiie decoding side to decide as to whether all the image data contained in the moving picture 
sequence undergo tiie intra coding or not without decoding the headers a overheads of tiie indivklual image data con- 
stituting the moving picture sequence. This offers an advantage of being able to enable tiie decoding side to carry out 
35 decoding witii simply varying display rate or decoding rate, and to make random access to the image at a desired time 
with ease. 

BRIEF DESCRIPTION OF THE DRAWINGS 
40 [0017] 

Fig. 1 is a diagram showing a video, data structure according to the MPEG-4; 
Fig. 2 is a diagram showing a concrete example of VOPs; 
Fig. 3 is a diagram showing an exanple of a conventional coded bit stream; 
45 Fig. 4 is a block diagram showing an intemal configuration of a VOP encoder in an embodiment 1 in accordance 
witii the present invention; 

Fig. 5 is a flowchart illustrating the operation of the VOP encoder of Fig. 4; 
Fig. 6 is a flowchart illustrating tiie operation of tiie INTRA/INTER decision section 14; 
Fig. 7 is a block diagram showing a configuration of the header multiplexer 8 as shown in Fig. 4; 
so Fig. 8 is a diagram showing an example of a coded bit sti'eam 30 output from tiie VOP encoder of the embodiment 
1 in accordance witii the present invention; 

Fig. 9 is a diagram showing an example of a coded bit stream 31 output from tiie VOP encoder of the embodiment 
1 in accordance witii the present invention; 

Fig. 10 is a block diagram showing a configuration of the header multiplexer 8 of the embodiment 1 for generating 
ss the coded bit stream 31 as shown in Fig. 9; 

Fig. 1 1 is a block diagram showing a configuration of a VOP encoder in an embodiment 2 in accordance with tiie 
present invention; 

Fig. 1 2 is a block diagram showing a configuration of tiie header multiplexer 8 as shown in Fig. 1 1 ; 
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S i?e pr^^^S^"^^ ^" °' ^ in an en*cx,lment 3 in accordance 

Ra 20 5 V^lUT^ the operation of the image decoding apparatus as shovm in Fig. 18; 

Ro fu. » 2^ H f the operation of the INTRA/INTER decision section 54 as shown in Fig 18- 

iSnfaL^hS^t^riJ ^^^^^^ 

Rg. 22 is a block diagram showing an internal configuration of the frame slop controller 69 as shown in Fk, 5i • 

Rg. 24 IS a flowchart Illustrating the operation of the VOP header analyzer 62 
^' 11^ modulo-time base 65 and VOP time increment 68- 

^?^d^?v«ttr;rrir:3^^^^ 

Rg. 27 a block diagram showing an example of the image decoding apparatus of the embodiment 3 in ac«„rt 

Ro II 'f,^ t'S^-^"^^ ^^"^ '^'^ information in the VOL header- 

S»'^'c:SShe pSL'S^ """"^ °' ^^^^^^ ^ - -^-nt 4 : 

Rg. 30 is a block diagram showing the frame skip VOP controller 86 of the embodiment 4 as shown in Fin 29- 

thj^is:.;;^^;""*^''^''^'^^'^'^ 

Sfce^CT^SeS:^"'''^"^''^^^ 
- S^SaifceSr^Jp^nt^^^ """'^ °' "^^^ ^V^- - embodiment 5 in 

i^e^Jn? "^"^"^ "^"^""^^ ^ °' embodiment 5 in accordance with the present 

Se preJem SoJ; °' ^"^'^^^ ^ °' 5 in accordance with 

2. ?he tel'em iS^^^^^^^ ^ ^"'^ -"^'^ ^ <^ -^'^n* ^ in accordance 

2»?Ja?c:^rCSL'l;^^^ "^"^ sn^^^o,.n embodiment 6 ^ 

Rg. 38 is a btockdiagram showing the decoded VOP selector 103 as shown in Fig. 37 

*e prL'e^ S^/""^*"^ °' ^^'^^ °' ''^^ embodiment 6 in accordance with 

di^^'^O^l^'^TT^ P''^'"^ °' ^ VOf' ««es8 mechanism at step ST56 by the 

so ^t:^tT^T^:::m' "^'"^ ^ '^^^ ^'^'^^ °' - ^ 

Rg. 42 is a block diagram showing the decoded VOP selector 107 as shown in Rg 41 

.Ks:^ °' '^'^ °' ^« ^'^'^ ' wHh 

55 ScS^'ii^^'TT^.'l^' °* '^'^ ^''^ « «»«P ST66 by the " 

aeooaea VOP selector 107 of the embodiment 7 in accordance with the present invention. 
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BEST MODE FOR CARRYING OUT THE INVENTION 

[0018] The best mode for carrying out the invention will now be described with reference to the accompanying 
drawings to explain the present Invention in more detail. 

5 

EMBODIMENT 1 

[0019] In the emtxxjiment 1 in accordance with the present invention, a VOP encoder will be described that 
employs the MPEG*4 video coding scheme disclosed in the ISO/IEC JTC1/SC29/WG1 1/N1 796, and comprises a cod- 

10 ing means and a multiplexing means. The coding means candies out coding based on information as to whether only 
the intra coding is applied to all the VOPs contained in the unit such as a VOL or GOV of each object which is an ele- 
ment of the present emtxxliment 1 . The multiplexing means adds to each object the information on whether only the 
intra coding is applied to all the VOPs contained in the unit such as a VOL or GOV, thereby generating a coded bit 
stream. Here, the intra coding refers to a coding mode that codes the VOP to be coded using only the information about 

15 that VOP itself without using the information about remaining VOPs. Thus, intra-coded VOP can be decoded by itself. 
[0020] Because the image coding apparatus of the present embodiment 1 is based on the MPEG-4 video encoder 
that carries out coding on a VOP by VOP basis, it is called a VOP encoder from now on. Since the operation of the exist- 
ing VOP encoder is disclosed in the ISO/IEC JTC1/SC29/WG1 1/N1 796 and the like, the operation of the encoder itself 
is only surveyed here, and the components of the present embodiment 1 will be desaibed in detail. 

20 [0021] Fig. 4 shows a configuration of the VOP encoder of the present embodiment 1. In Fig. 4. the reference 
numeral 1 designates a geometry encoder; 2 designates geometry coded data; 3 designates locally decoded geometry 
data; 4 designates a motion-compensation predictor; 5 designates motion information; 6 designates GOV multiplex 
information; 7 designates an object intra-coding instruction signal; 8 designates a header multiplexer; 9 designates a 
bit stream after header information multiplexing; 10 designates a video signal multiplexer; 11 designates a predicted 

25 image; 12 designates a subtracter; 13 designates a prediction error Image; 14 designates an INTRA/INTER decision 
section; 1 5 designates texture data to be coded (refen^ed to as an Input Image from now on); 16 designates macroblock- 
based coding mode information; 1 7 designates a texture encoder: 1 8 designates texture coded data; 1 9 designates a 
locally decoded prediction error image; 20 designates an adder; 21 designates locally decoded texture data; 22 desig- 
nates a memory; 23 designates reference texture data; and 24 designates a coded bit stream. 

30 [0022] Next, the operation of the VOP encoder of the present embodiment 1 as shown in Fig. 4 will be described 
briefly. Fig. 5 is a flowchart illustrating the operation of the VOP encoder of the present entiodlment 1 as shown in Rg. 
4. 

[0023] An input object image is supplied to the geometry encoder 1, motion-compensation predictor 4. 
INTRA/INTER decision section 14 and subtracter 12. In this case, the geometric data of the input object image is sup- 
35 plied on every 1 6x1 6 pixel block basis called an alpha block, and the texture data of the input object image is also sup- 
plied on every 16x16 pixel block basis called a macroblock. 

[0024] First, the geometry encoder 1 encodes the input alpha blocK and outputs the geometry coded data 2 and 
locally decoded geometry data 3 (step ST1). Since the coding processing of the geometry encoder 1 is off the subject 
of the present invention, the description thereof is omitted here. The geometry coded data 2 is transferred to the video 
40 signal multiplexer 1 0, and the locally decoded geometry data 3 is delivered to the motion-compensation predictor 4 and 
texture encoder 17. 

[0025] Subsequently, the motion-compensation predictor 4 reads the reference texture data 23 from the memory 
22. and carries out macroblock-based block matching to obtain the motion information 5 (step ST2). Specifically, the 
motion-compensation predictor 4 obtains the nrustion information 5 by carrying out the block matching of only an object 

45 included in the macrotrfock on the basis of the locally decoded geometry data 3. Then, the motion-compensation pre- 
dictor 4 reads from the memory 22 the reference tenure data 23 at tiie location conesponding to the motion infornnation 
5, and generates the predicted image 1 1 from tiie bcally decoded geometry data 3. The motion information 5 gener- 
ated by the motion-compensation predictor 4 is supplied to the video signal multiplexer 10, and the predicted image 1 1 
is fed to the subtracter 1 2 and adder 20. 

so [0026] Then, tiie INTRA/INTER decision section 14 decides on the basis of tiie externally set object inti-a-coding 
instruction signal 7 tiie coding mode of the individual macroblocks of tiie VOPs to be coded, and selects an input image 
in response to the coding mode decided. The image selected (in the case of tiie inter coding, it is tiie prediction error 
image 1 3} is supplied to tiie texture encodeir 1 7; and the macroblock-based coding mode inf6rmatioh 16 decided is sup- 
plied to tiie video signal multiplexer 10 (step ST3). Here, tiie object intra-coding instruction signal 7 is information indi- 

55 eating whether all tiie VOPs contained in tfie unit such as a VOL or GOV are to be coded only by the intra coding or not, 
which is set by a user operating a switch or inputting a command. When all the VOPs are to be coded by only the Intra 
coding, tiie signal is turned ON ("H, and othenwise it is turned OFF ("0^. 

[0027] Fig. 6 is a fbwchart illustrating the operation of tiie INTRA/INTER decision section 14. The operation will 
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now be d^ibed with reference to Rg. 6. Rist. the operation is switched In response to the value of the object intra- 
coding instruction signal 7 (step ST3-1). When the object intra-coding instruction signal 7 is ON. the INTRA/INTER 
dectsion section 1 4 selects the input object image as the input image 1 5. sets the maaoWock-based coding mode infor- 
mation 16 to the intra-coding mode, and supplies the input image 15 selected to the texture encoder 17 (step STZ-2). 

^ . !*^® inlra-coding instruction signal 7 input is 0H=, the INTRA/INTER decision 

J??i°Ar4Q/^A^rTL"f '"^ ^ ^^'^ macroblock according to the method defined by the ISO/IEC 

^ 'T^^- INTRA/INTER decision section 14 selects as input image 15 the 

input object image when the macroblock-based coding mode selected is the intra-coding mode, but the prediction error 
image 13 when the maaoblock-based coding mode selected is the inter-coding mode, and supplies it to the texture 

10 encoder 17 (step ST3-3). In addition, the INTRA/INTER decision section 14 supplies the video signal multiplexer 10 
"^I^^ fnacroblock-based coding mode selected as the macroblock-based coding mode information 16 
'^^1 . Returning to the flowchart of Rg 5, the texture encoder 17 encodes the input image 15 according to the 
method def^ by the ISO/IEC JTC1/SC29WG11/N1796. thereby obtaining the texture coded data 18 and localty 
P;;ediction error image 19 (step ST4). In the course of this, the texture encoder 17 carries out the coding of 
fili^ ^ *^ ^ response to the locally decoded geometry data 3. The texture encoder 1 7 transfers the 

torture coded data 18 to the video signal multiplexer 10. and the kically decoded prediction error image 19 to the adder 

[0030] T>ie adder 20 sums up the predicted image 11 and tfie locally decoded prediction error image 19 to generate 
the locally decoded texture data 21 (step ST5). and writes the sum to the merrwry 22 (step ST6). The foregoinq 
so processings are iterated for each macroblock. and when the processings of the entire macroUocks included in a single 
VOP are completed, the coding processing of the single VOP is terminated. OBienwise. the coding processing of the 
remaining macroblocks is continued (step ST7). 

[0031] The header multiplexer 8 multiplexes the individual items of the header information into the bit stream 9 and 
supplies It to the video signal multiplexer 1 0 (step ST8). 
S5 [0032] The video signal multiplexer 1 0 multiplexes the bit stream 9. which consists of the multnlexed items of the 
header irformation. with the geometry coded data 2, motion information 5. texture coded data- 18 and macroblock- 
based coding mode information 16. and outputs tiie coded bit sb-eam 24 (step ST9). 

"^f*; operation of the header multiplexer 8. which characterizes the present embodiment 1. will be 
descnbed in detail. 

m34] Fig. 7 shews a configuration of the header multiplexer 8 as shown in Rg. 4. In Rg. 7. ttie reference numeral 
25 designates a VO header multiplexer; 26 designates a VOL header multiplexer; 27 designates a GOV header multi- 
plexer selector; 28 designates a GOV header multiplexer; and 29 designates a VOP header multiplexer 
, . 5 ^° ^^"^^^ multiplexer 25 generates a bit stream into which the VO header is multiplexed, and supplies 

It to ttie VOL header multiplexer 26. The VOL header multiplexer 26 multplexes into the bit stream fed from the VO 
header muftiplexer 25 various VOL header items including an object intra-coded indicator signal T as one of them 
Here, the ot)|ect intra-eoded indicator signal T refers to the information on whether or not all the VOPs contained In the 
unit such as a VOL or GOV are coded by only ttie intra coding. The object Intra-coded Indicator signal T can be multi- 
plexed as 1-bit information in the VOL header information, which is placed at "1 " when the object intra-coding instruction 

K ^"f u^' ^ s**®*" a«er the multiplexing Is supplied to the GOV 

« header multiplexer selector 27. kh~i""wwv 

[0036] The GOV header multiplexer selector 27 decides the output destination of the bit stream fed from the VOL 
h^der multiplexer 26 in accordance wNh the GOV multiplex Information 6 that Indicates whether multiplexing of tfie 
GOV headers to be carried out or not According to the MPEQ-4. the GOV header need not be contained In the coded 
bit stream. Thus, ttie encoder of the present embodiment 1 can selectively multiplex the GOV header using the GOV 
r " ^^^^^^ ^" configured such that H determines in advance as to 

whether the GOV header is to be multiplexed or not In other words, the encoder can be configured such that it does 
nrt compnse the GOV header multiplexer selector 27. and supplies flie output of the VOL header multiplexer 26 directiy 
4 i!^ u '""WPlexer 29 without passing ttirough the GOV header multiplexer 2a or that it supplies the outout 
o^^e VOL header multiplexer 26 to the VOP header multiplexer 29 through the GOV header multiplexer 28 
[0037] When the GOV multiplex information 6 indicates tiiat the GOV header need not be multiplexed the bit 
1^ *° *® nuiltiplexer 29 without passing through the GOV header multiplexer 28 

[003^ h conb^ wHh this, when the GOV multiplex information 6 indicates that the GOV header must be multi- 
plexed, the bit stream is supplied to the GOV header niultlplexe-r 28. In response to this, the GOV header multiplexer 28 
multiplexes the QOV header Into the bit stream fed from the GOV header multiplexer selector 27. and supplies the out- 
55 put bit sti-eam to Vne VOP header multiplexer 29. . c» i le uui 

ISS!^ ^ ^JJ?^ multiplexer 29 multiplexes the VOP header into the bit stream which is supplied 

directiy from ttie GOV header multiplexer selector 27. or from the QOV header multiplexer selector 27 via the GOV 
header multiplexer 28, and provides the output bit sb-eam 9 to the video signal multiplexer 10 



30 



35 



45 



50 



BNSOOCID: <EP 102688SA1J_> 



6 




EP1026 899A1 

[0040] Fig. 8 shows an example of the coded bit stream 30 output from the VOP encoder of the present embodi- 
ment 1 in accordance with the present Invention. It is an example of the coded bit stream 24 in Fig. 4. The coded bit 
stream 30. like the conventional coded bit stream as shown in Rg. 3, comprises a VO header 30a. a VOL header 30b. 
a GOV header 30c, a VOP header 30d and VOP data 30e, each of which consists of a start code and header informa- 
£ tion or data information. In the present embodiment 1 , the VOL header 30b includes an object intra-coded indicator sig- 
nal 7 multiplexed thereinto. Thus, the object intra-coded indicator signal T indicates that the^entire VOP data 30e 
constituting the VOP associated with the VOL header 30b are intra coded. 

[0041] Here, each VOP data 30e includes texture data (not shown) and geometric data (not shown) that are coded 
for each macroblod< constituting a unit to be coded, and is multiplexed with the coding mode information 16 that indi- 

10 cates as overhead information whether the macroblock is intra coded or inter coded for each maaoblock However, 
when the object intra-coded indicator signal 7' is ON. that is. when the entire VOP data 30e of the VOL or GOV are intra 
coded, it is unnecessary to multiplex the coding mode information 16 of each macroblock constituting the VOP data, 
thereby reducing the amount of information of the coded bit stream. This holds true in all the following embodiments. 
[0042] Incidentally, the VOL header 30b is set on the VOL (Video Object Layer) by VOL basis. Thus, when the VO 

75 consists of a plurality of VOLO and V0L1 as shown in Fig. 1 , the VOL header 30b is set for each VOL. and the object 
intra-coding instruction signal 7 is also set Ibr each VOL. 

[0043] In addition, when the GOV header multiplexer selector 27 decides tiiat it is unnecessary for the GOV header 
multiplexer 28 to multiplex the GOV header, the coded bit stream 30 has a st'ucture as shown in Fig. 8 except the GOV 
header 30c. 

20 [0044] As described above, the present embodiment 1 has such a configuration that multiplexes into the VOL 
header the object intra-coded indicator signal 7' indicating that the entire VOP data, which constitutes the GOV subor- 
dinate to the VOL or constitutes the VOL without using tiie concept of the GOV, are intra coded. As a result, an image 
decoding apparatus can decide as to whether all the VOPs contained in the object are Intra coded or not by only decod- 
ing and analyzing tiie object Intra-coded Indicator signal T without decoding tiie Individual VOP headers. This makes It 

25 possible for the decoding apparatus side to carry out decoding with varying the display rate or decoding rate with ease, 
and to generate the coded bit stream that enables simple access to tiie VOPs at a desired time. 
[0045] Although tiie object Irtra-coded indicator signal T is multiplexed into the VOL header 30b in the coded bit 
stream 30 as shown in Fig. 8 in the foregoing desaiption, this is not essential to the present Invention. For example, the 
object intra-coded indicator signal T can be multiplexed into the GOV header 31c In a coded bit stream 31 as shown in 

30 Fig. 9, so that the object intra-coded indicator signal is defined on tiie GOV basis lower in rank tiian the VOL. This ena- 
bles tiie coding and the multiplexing of the object intra-coded indicator signal on the GOV basis. 
[0046] In this case, the header multiplexer 8 can be configured as shown In Rg. 10 In which tiie object inti-a-coded 
Indicator signal 7 is not multiplexed by a VOL header multiplexer 32, but by a GOV header multiplexer 33. Thus, tiie 
object intra-coded indicator signal 7 functions as tiie information indicating whether the entire VOP data 31 e contained 

35 in the GOV are intra coded or not. and is multiplexed together witii tiie GOV header Information into the GOV header 
31c as shown in Fig. 9 by tiie GOV header multiplexer 33. 

[0047] In addition, although tiie present embodiment 1 Is configured such tiiat the header multiplexer 8 generates 
the 1-bit object inti^a-coded indicator signal 7 from the ot)ject intra-coding insta'uction signal 7, it is not essential to tiie 
present invention. For example, the object intra-coded indicator signal T can have nnore than one bit Alternatively. 
40 when the object intra-coding instruction signal 7 indicating whether the entire VOP data constituting the VOL or GOV 
are to be Intra coded or not is represented In tiie form of bit Information, the object Intra-coding instruction signal 7 itself 
can be multiplexed as tiie object intra-coded indicator slgnaj 7*. 

[0046] Furthermore, although the coding apparatus of the present embodiment 1 is innplemented in the form of 
hardware as shown in Rg. 4 and so on. this is not essential to tiie present invention. For example, tiie coding apparatus 
45 can be implemented in software. In other words, the functions of tiie present embodiment 1 can be Implemented by 
means of a CPU or MPU tiiat executes tiie program as shown in Figs. 5 and 6. This also applies to all the following 
embodiments. 

EMBODIMENT 2 

50 

[0049] In tiie present embodiment 2 in accordance witii the present invention, a VOP encoder will be described that 
comprises the following coding means and multiplexing means in a video coding system according to the MPEG-4 dis- 
closed in the ISO/IEC JTC1/SC29/WG1 1/N1 796. The coding means cames out coding of all the VOPs contained in tiie * 
unit such as a VOL or GOV in response to tfie object int'a-coding instruction signal 7. the infornnation indicating whether 
55 only imra coding is to be carried out or not The multiplexing means multiplexes into tiie coded bit sti-eam the object 
Intra-coded Indicator signal 7 and display time multiplex Identification information 34. The object int-a-coded indicator 
signal 7 is tiie information indicating whether all the VOPs contained In the unit such as a VOL or GOV undergo only 
the intra coding or not The display time multiplex identification information 34 indicates whetiier the absolute display 
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time information of an the VOPs contained in the unit such as a VOL or GOV is to be collectively multiplexed or not 
[OMO] Fig. 1 1 shows a configuration of the VOP encoder in the present embodiment 2. The VOP encoder as shovm 
.n F,g. 1 has a co-Tf .guration very dose to the VOP encoder of the embodiment 1 as shown in Rg TSe ba^c oST 
5 "■'"""^ '° embodiment 1. The present embodiment 2 diffe^' from thfto egoTng 

^TJ! H « "'"^1°' "^^^^^ «• "^S- 1 ' • ""-"e^al 34 designates the d?s^5 

S H wnD^"^*^*"" >nformaton; and 35 designates a time code representing the absolute disp ay tVme X 
Sri!S T'^Ji^^'"? '^'"^'^ ««"«oai to the corresponding members of Fig. 4 des^naTeS bJ^he 

10 [0051] Rg. 12 shows a configuration of the header multiplexer 8 as shown in Rg. 11 In Fig 12 the reference 
numeral 36 designates a VOL header multiplexer. °' ' '«e^ence 

[0052] -me header multiplexer 8 as shown in Fig. 11 cames out in its VOL header multiplexer 36 the followlno mul- 

,5 JSn ^KP'^es the 1-bit display time multiplex identification information 34 into the ?0L SeaS^ 

h indicator signal T is ON. that is. when It indicates that all the VOPs conS 

mttie unit such as a VOL or GOV are intra coded; and multiplexes into the VOL header information collecliveirtrS 

Sp"rSica^«riSSc^^^^^ 

on ."^'®:*^®*''"®'*^®35istirneinfonrationdisdosedinthelECstanda«lpublication461 for "time and control 

^ codes for v.deo tape recorde,^". It Is the information for defining in hours, minutes and secondrtL dispTaytaeTme 

^ng able to access a desired frame only by designating the value of the time code 35 by adding this InforLton to 
ea^ frame when carrying out frame based edition in a video editor for business use mrormation to 

25 Sf th. vnf h^^H^'^'^ir^ configuration is the same as the header multiplexer8 as shown in Fig. 7. only the oper- 
T^.? VOLS!ir ' «^ 12dWerentfromthatof theembodiment 1 will be deifoed. ^ 

S "\"'*P'««^36 multplexes information required into the bit stream supplied from the VO 

header multiplexer 25 in accordance with the following rules 1)-5). 

1^^'^"° "^"^ ^"^^ '"'^ ^^'^ "^^'^ ''^"^'"fl a™* decompressing the individ- 

2) Multiplexing the ol^ect intra-coded indicator signal T 

^^^'''^.'^ ""'e ™'tiP'ex identificatton Information 34 when the object intra-coded indicator signal 
the i^a (SLgcS " ^^^^ such as i VOL or GOV are SjrtS to 

The di^lay time multiplex identificatton information 34 is 1-bit information indicating whether to multiolex the 

wise rt IS set at "0" representng OFF When the object infra-coded indicator signal 7 r^resents OFF me dS» 
time multiplex Identification information 34 is not multiplexed. esems urr. me aispiay 

4) Multiplexing, when both the object intra-coded indicator signal r and the display time muWDlex identif ication 
irrtomiaton 34 are ON, the time codes 35 in all the VOPs in t^ VOL into the VOL heaJer sSS,^ 

TZr^^t l^'"" ^' i^*^ a certain VOL includes 30 pi^^f 

30 time codes 35 are multiplexed into the VOL header intormatfon section 

W0S6] Figs. 13. 14 and IS each illusfrate a coded bit sfr earn output from the VOP encoder of the present embodi- 
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lr°^^cc • "^f. Stream 37 as shown in Fig. 13 illuefrates a case when the object intra-coded indicator stanal 

Trie ?i SJafZ'",?''.:? "IT"- ^^""^^ ^''^^ relative time*e1e2° 

5oP ik^L • absolute display time that is multiplexed into the GOV header 37c to the time the 

VOP IS dSplay^. IS mulbplexed into the VOP header infomiation 37d of the individual VOPs (thfe-relalive time inSrJ^ 
T 1- "^I'ml^^^""^ '^""^ °^ "^"^ incremented, though not sho^n here). The de^ sldTdSiSs- 
play time of the VOPs according to the relative time information • «°e«»'ngsiaeaeciaesinedis- 

Sr I. ^ ^V"""*^*"^ '^'^ the case when the object intra-coded indicator 

signal 7 is ON, but the display time multiplex identification information 34 is OFF. in which case the time code 35 ifnot 
muttiplexed into the VOL header information 381. As in Rg. 1 3. the relative time iiiforrnJti^ n?mS«lS^ vS 
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header information 38d of the individual VOPs. It Incficates the relative time from the reference time code 35 or the abso- 
lute display time that is multiplexed into the GOV header 38c to the time the VOP is displayed. 
[0059] The coded bit stream 39 as illustrated in Fig. 15 represents the case in which both the object intra-coded 
indicator signal 7 and the display time multiplex identification information 34 are ON. In this case, the time codes 35 in 
5 all the VOPs in the VOL are multiplexed into the header information section 39b. In this case, the relative time informa- 
tion in the VOP header information section 39d can be multiplexed without change, or multiplexing of the relative time 
information into tiie VOP header information can be skipped to avoid the duplication witii tiie time codes in the VOL 
header information 39b. 

[0060] As descrajed above, the present embodiment 2 is configured such that it multiplexes into the VOL header 
10 the object intra-coded indicator signal 7* which indicates tiiat all the VOP data constituting tiie VOL undergo the intra 
coding, the display time multiplex identification information 34. and tiie time codes indicating the absolute display time 
of all the VOPs in the VOL. This makes it possible for tiie image decoding apparatus tiiat decodes the VOPs by receiv- 
ing ttie bit stream generated by tiie present coding apparatus to decide as to whether all tiie VOPs contained in tiie VOL 
are intra coded or not, and whether the time codes of all the VOPs are collectively multiplexed or not, without decoding 
75 and analyzing tiie individual VOP headers. This makes it possible for the decoding apparatus to readily identify tiie VOP 
to be decoded before starting decoding of the VOP. and to carry out decoding witii varying tiie display rate and decoding 
rate, and to access the VOP at a desired time with ease. 

[0061] Although the foregoing example multiplexes into the VOL header the object intra-coded indicator signal 7, 
display time multiplex identification information 34 and time codes 35 as in the coded bit streams 37-39 illusti-ated in 
20 Figs. 13. 14 and 15. this is not essential to tiie present invention. For example, the coded bit stream can be configured 
as in the following examples 1 and 2. 

(EXAMPLE 1) 

2? [0062] As shown in the coded bit stream 40 of Fig. 1 6. tiie object inti^a-coded indicator signal 7 can be multiplexed 
into tiie VOL header 40b. whereas tiie display time multiplex identification information 34 can be multiplexed into tiie 
GOV header 40c when the object inti-a-coded indicator signal 7 of tiie VOL belonging to this GOV is ON. and-the time 
codes 35 of all tiie VOPs contained in the GOV layer can also be multiplexed into the GOV header 40c when the display 
time multiplex identification information 34 is ON. In tills case, the display time multiplex Identification information 34 

30 indicates whetiier the time codes 35 of all tiie VOPs contained in tiie GOV are multiplexed collectively Into ti)e GOV 
header or not. 

(EXAMPLE 2) 

35 [0063] As shown in the coded bit stream 41 of Fig. 1 7. ail tiie object intra-coded indicator signal 7\ tiie display time 
multiplex identification Information 34 and the time codes 35 can be multiplexed into the GOV header 41c. In this case, 
the object intra-coded indicator signal 7' indicates whetiier all the VOPs contained in tiie GOV are intra coded or not, 
and tiie display time multiplex identification information 34 indicates whether the time codes 35 of all the VOPs con- 
tained in the GOV are multiplexed collectively Into the GOV header or not. 

40 [0064] Thus generating the coded bit stream makes it possible for the decoding side to readily identify the VOP to 
be decoded on the GOV basis, to carry out decoding witii varying the display rate and/or decoding rate, and to make 
simple access to the VOP at a desired time. 

EMBODIMENTS 

45 

[0065] In the embodiment 3 in accordance with the present invention, a VOP decoder will be described for regen- 
erating VOP images by decoding tiie coded bit stream generated by ttie VOP encoder described In the foregoing 
embodiment 1. More specifically, an image decoding apparatus will be described for decoding the object intra-coded 
indicator signal 7' described in the foregoing embodiment 1 from the coded bit stream, and for controlling the display of 

so the decoded VOPS in accordance witii the value of the signal 7. 

[0066] First, a configuration and operation of tiie Image decoding apparatus (VOP decoder) in the present embod- 
iment 3 will be described. Because tiie operation of the existing VOP decoder is disclosed in the ISO/lEC 
JTC1/SC29/WG1 1/1^1 796' and so fbrtii, the operation of ttie VOP d^cdder itself will be only outiiried herfe. In the follow- 
ing description, tiie function characterizing tiie VOP decoder of ttie present embodiment 3, that Is. the function to 

55 decode the object intra-coded indicator signal, and to selectively decode the VOP images based on the value of tiie sig- 
nal will be mainly described. In tiie following description, it is assumed tiiat tiie coded bit stream 30 as shown in Fig. 8 
is input to the VOP decoder. 

[0067] Fig. 18 shows an internal configuration of the VOP decoder of tiie embodiment 3 in accordance with the 
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« assumed here that the VOP data consists of the texture data and geometric data as in the 

[0068] In F^g. 18. the reference numeral 42 designates a header analyzer; 43 designates a bit stream whose 
header mformat.on has been analyzed: 44 designates a video signaJ analyzer; 45 designatls gSmefry cSil^ 

nwbon conpensator; 53 des^nates decoded prediction texture data; 54 designates an INTRA/INTER d«S^2L 
rao^^"^ "T" 'T^^^"^ designates a memory; and 57 designaL reference teT^dSa ' 
[0069] Fig. 19 ,s a flowchart Illustrating the operation of the image decoding apparatus as shewn in Ro is Th* 
operaton will now be described with reference to Figs. 18 and 19 aPParatus as shown in Fig. 18. The 

!Sr r^^H: ^° ^PP"®d *° ^a'yzer 42. Which analyzes the VO header VOL 

Sed. i's^lt:. rrsar ?dSt'srr ' ^ -'"'^^^^ ^-^^ ™ - 

?6"S?e?e2dlf4f '^^'^ ^ 5^ -P^Ss SCeSie^^J^Sd^ 

46, texture decoder 49 and motoncompensatorS2. respectively (step ST11) a«» wiry aecoaer 

[0074] The niotion compensator 52 produces the decoded prediction texture data 53 on the basis of the reference 
tj- data 57 read from the memory 56 and the motion information 51 supplied from the vidS ^nir^L^^^^^^ 

toture decoder 49 restores the image data from the texture coded data 48 in accoidance with the ore 
t"^dl'?(lp^^^^^^^ .SO/IEC JTC1/SC29/WG11/N1796. and gene^Thrd^'Sr 

00761 H^^^SxRA/iliT^R?^ l^t®' ^ INTRAflNTER dedsion section 54. 

ir^th^otis™?^^^^^^^ 

[0079] When the object intra-coded indicator signal 7 is ON ("YES" at step ST1 5-1 ) the INTRA/INTPB H«r«i«, 
se^on 54 immediately outputs the texture data 50 as the texture data 55 (st^ ST15-t) "^"^"^^^ 
[0080] In contrast with this, when the object intia-coded Indicator aonal r is off rMO" =.» h» 

as texture data 55 (step STI 5-2). and when rt is the inter-coding mode ("NO" at step ST15-3) the INTRA/INTER ded 

i^T^^ S "'^ P^^^''^'"" « fed from the modoTcSm^^^JoJ S^lel^^ 

f "^'^ ^' ^""^ ""^""^ ^""^ ''^^ as the output texture data 55 (step ST15^) ^ decoded 

[0081 Returning to the flowchart of Fig, 19. because the output texture data 55 is used in the subseauent VOP 

^liio« ^ !. !^ Pf«Jetennined in the coding side and decoding side. In response to the 

n«rt VOP ,s not detected, the processing returns to step ST1 1 to carry out the video signal analysis and on«««J hT* 
oorrtmuing the decoding of the macroblocks associated with the current VOP (step 1x1^ 
f.? VOP decoder of the present embodiment 3 opeiates as follows First it deddes as to 

^JXTJT^^ "'9'^' ^' '^^^ ^' VOP data 30e constitutinVSJ VOL are 

SSe t^ redJSSelSSJ^'"' « *«J"«^a-coding mode or not on the macroblock basis. This makes it 

F« ^1 iJ^J^I^^ r a'^°'^'« "^^ed for the processing of step ST15-3. 

10083] Fig. 21 shows an internal configuration of the header analyzer 42 of the oresent emhnrtimon* •» o= - 
Fig. 18. and particularly a configuration of the VOP header analyzer «^n LteMn%?i S^^^ 
designatesastart code analyzer;59designatesaVO header analyzer; 60 designa^^ 
.gnates a GOV header analyzer; 62 designates a VOP header analyzer; 63 dwS^ afime ode M ^^^^ 
mcdulo-tme base analyzer; 65 designates a modulo-time base; BS^esiZT^L ^JSp^eTX^ 
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generator; 67 designates a VOP time increment analyzer; 68 designates a VOP time increment; 69 designates a frame 
skip controller; 70 designates decoded VOP absolute display time; 71 designates VOP rate information as the display 
rate information set on the decoder side; and 72 designates a video information header analyzer. 
[0084] Fig. 22 is a block diagram showing an internal configuration of the frame skip controller 69 as shown in Rg. 
5 21 . in Fig. 22, the reference numeral 73 designates an object intra-coded decision section; and 74 designates a frame 
skip VOP decision section. 

[0085] Next, the operation of the header analyzer 42 will be desaibed in detail. 

[0086] Fig. 23 is a flowchart illustrating the operation of the header analyzer 42 as shown in Fig. 21 . which illus- 
trates the header analysis at step ST10 as shown in Fig. 19 in more detail. 

10 [0087] The header analyzer 42 of the present embodiment 3 decodes the object intra-coded indicator signal 7' from 
the bit stream, and carries out the frame skip control based on the information provided by the signal. 
[0088] Here. Irame skip control" refers to the following operation. When canying out the Image decoding using a 
software decoder in such an environment as only limited resources are available like a CPU and memory in a PC (per- 
sonal computer) and WS (workstation), and hence all the coded VOPs cannot be decoded, the "frame skip control" 

15 restricts the VOPs to be decoded by skipping reading of the remaining VOPs. A method of using the object intra-coded 
indicator signal 7* will be desaibed later. 

[0089] In the header analysis by the header analyzer 42, the start code analyzer 58 first analyzes the start code 
contained in the coded bit stream 30 supplied (step ST1 8). The start code analyzer 58 supplies tiie bit stream to the VO 
header analyzer 59 when the analyzed start code indicates a VO (step ST19), to the VOL header analyzer 60 when tiie 
20 analyzed start code indicates a VOL (step ST20). to the GOV header analyzer 61 when the analyzed start code indi- 
cates a GOV (step ST21), and to the VOP header analyzer 62 when the analyzed start code indicates a VOP (step 
ST22). Incidentally, the bit stream is supplied to the video signal analyzer 44 when the VOP header analyzer 62 com- 
pletes Its analysis. 

[0090] The VO header analyzer 59 analyzes the VO header information In the bit stream fed from the start code 
25 analyzer 58, and supplies the bit stream after the analysis to tine start code analyzer 58 (step ST23). 

[0091 ] The VOL header analyzer 60 analyzes the VOL header information and the object intra-coding indicator sig- 
nal 7 in the bit sti-eam fed from tiie start code analyzer 58. and supplies the bit stream after tiie analysis to the start 
code analyzer 58. and the object intra-coded indicator signal 7' analyzed to the VOP header analyzer 62 and 
INTRA/INTER decision section 54 (step ST24). 
30 [0092] The GOV header analyzer 61 analyzes the GOV header information in the bit stream fed from the start code 
analyzer 58, and supplies the bit stream after the analysis to the start code analyzer 58 (step ST25). in the course of 
this, the time code 63 contained in the analyzed GOV header infbnnatlon is supplied to the VOP header analyzer 62. 
The definition of ttie time code 63 was given in the description of the embodiment 2. 

[0093] Next, the operation of the VOP header analyzer 62 which conesponds to step ST26 will be described. 

35 [0094] Fig. 24 is a flowchart illustrating the operation of the VOP header analyzer 62. 

[0095] First, tiie bit stream input to the VOP header analyzer 62 is supplied to the modulo-time base analyzer 64, 
which analyzes tiie modulo-time base (step ST26-1), and supplies the modulo-time base 65 analyzed to tiie decoded 
VOP absolute display time generator 66, and tiie bit stream after tiie analysis to the VOP time increment analyzer 67. 
[0096] The VOP time increment analyzer 67 analyzes tiie VOP time inaement in the bit stream supplied (step 

40 ST26-2), and supplies the VOP time increment 68 analyzed to the decoded VOP absolute display time generator 66. 
and the bit stream after the analysis to the frame skip controller 69. 

[0097] The decoded VOP absolute display time generator 66 generates the decoded VOP absolute time 70 from 
the modulo-time base 65, VOP time increment 68 and time code 63, and supplies it to tiie frame skip controller 69 (step 
ST26-3). 

45 [0098] Here, the modulo-time base 65 is the information Indicating the time In seconds at which the VOP is to be 
displayed from a particular reference time defined by the time code 63 as shown In Fig. 25. The amount of seconds is 
represented by the number of "Is" witfi the additional "0" indicating the end of the data. 

[0099] The VOP time increment 68 is the information for fine adjusting the display time with an accuracy of 1/1000 
second within one second from the time determined by tiie modulo-tame base 65 as shown in Fig. 25. Thus, the MPEG- 
50 4 can determine tiie VOP display time at an accuracy of 1/1000 second. For example, the decoded VOP absolute dis- 
play time (time code) is generated as follows. When the modulo-time base 65 of tiie VOP to be decoded is "10", ttie 
VOP time increment 68 is "000000" (when the VOP time increment is 6-bit accurate), and the reference time defined by 
the tirhe code 63 is "00 hour 1 2 minutes 34 seconds"! the absolute display time of the decoded VOP becomes "00 h6ijr 
12 minutes 35 seconds". 

55 [0100] Subsequently, in tiie frame skip controller 69 as shown in Fig. 22. tiie object intra-coded decision section 73 
first determines tiie destination of tiie input bit sti'eam in accordance with the object intra-coded indicator signal 7' (step 
ST26-4). More specifically, it decides as to whether tiie object intra-coded indicator signal 7 is ON or not, and when it 
is ON. that is. when a decision is made that all the VOPs In the VOL are intra coded ("YES" at step ST26-4), the desti- 
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^ stream is switched to the frame sWp VOP decision section 74. In contrast when the object irtra- 
S^^r?^ ^ * '''^ *° ^'^^ intbmiation header 

[01 01 1 -The frame sWp VOP decision section 74 makes a decision as to whether the VOP to be analyzed is the VOP 
5 to be dModed or not in response to the decoded VOP absolute display time 70 fed from the decoded VOP absolute 
display tirne generator 66. and to the VOP rate information 71 that is set on the decoder side at a value lower than that 
of the encoder side for frame skipping (step ST26-5). When the frame skip VOP decision section 74 decides that the 
decoding IS necessary ( YES" at step 3726-5). it supplies the input bit stream fed from the object intra-coded decision 
,n !! ° video information header analyzer 72. On the contrary, when if decides that the analysis is unneces- 

10 sary ("NO" at step ST26-5), it supplies the bit stream to the start code analyzer 58 r eces 

[0102] Here, the VOP rate information refers to display rate information indicative of the number of VOPs to be dis- 
played per second, which VOPs are included in the prescribed unit such as the VOL and GOV For example, when the 
VOP rate infomiation is 2 pieces/second, two VOPs are displayed per second, which is equivalent to display each VOP 
. «*«=«led VOP absolute time 65 of the first VOP is "00 hour 01 minute 00 second- 

is and the VOP rate information is 1 piecefeecond. a dedsion is made that such VOPs are to be decoded that have the 
absolute display tme "00 hour 01 minute 01 second". "00 hour 01 minute 02 second", and so on. which are obtained 
by succ^sively adding one second to "00 hour 01 minute 00 second". Hius. the decoding side can implement the VOP 
frame skipping by varying the VOP rate information 71 set on the decoder side and the VOP rate information set on the 
encoder side from 1 0 pieces/second to 2 pieces/second, for example 
^ SpSma- "^^^ ^ ^«=Wes that the object intia-coded indicator signal T is 

;x J. u ^ ST26-4). or when it decides that the object infra-coded indicator signal T is ON ("YES" at step ST26- 
!u .! ^y°'' section 74 decides that the VOP to be analyzed has to be decoded ("YES" at step 

ST26.5). the video iriformation header analyzer 72 analyzes the video information headers in the bit stream fed from 
the frame skip controller 69, and then supplies the bH stream to the start code analyzer 58 (^ep ST26-6) Thus the start 
^ ^^'^ "'^^^ ^'"9"^' ^^'y^®' ^ *e coded bit stream 43 whose headers are analyzed 
^ ^ : intra-coded decision section 73 decides at step ST26-4 that the object intra- 

coded indicator signal 7' is OFF. it supplies the bit stream fed to the VOP header analyzer 62 to the video information 
hrader analyzer 72 without passing through the frame skip VOP decision section 74. thereby preventing the VOP frame 
sKippinQ. 

^ IV.^ '® " ensured in this case that all the VOPs in the VOL are intra coded, and hence all the 

riS oiITbSieeTJlrSp^^' *° "^^"^^ ^"^^^ " *® predictive coding is car- 

[0106] On the other hand, when the object intra-coded decision section 73 decides at step ST26-4 that the obiect 
'T:^^ indicator signal T is ON. the frame skip VOP deciston section 74 decides at the next step ST26-5 as to 
whe^er the currerrt VOP to be analyzed has to be decoded or not in response to the VOP rate inform^fon 62 and the 
S fh Jno*^'^-^ infomiation header analyzer 72 with only the input bit stream with which a decision is made 
that the VOP decoding is required, thus enabling the VOP frame skipping. 
[0107] This is because when the object intra-coded indicator signal T is ON. it is ensured that all the VOPs in the 
VOL are intra coded, and hence the decoder can immediately select a desired VOP to be decoded. This makes it pos- 
40 sible to carry out the frame skip control freely 

'^^'k« ^® described above, the present embodiment 3 is configured such that it analyzes, when decoding the 
cod^ bit stream including the ol>|ect intra-coded indicator signal 7' multiplexed into the VOL header, the object intra- 
coded mdicator signal T. This makes it possible for the decoder side to carry out. when the object intra-coded indicator 
« Z"! x'^o ' *'^J'"PP'"9 of any VOPs in accordance with the VOP rate infomiation 71 set on the decoder side so 
45 that the VOPs selected are subjected to a processing such as display 

[0109] Although the foregoing description is made by way of example that employs the coded bit stream 30 as 

^TV", !! ^s ^ obiect intra-coded indicator signal T 

IS multplexed into the VOL header 30b, the present imrention is not limHed to this. For example, the coded bit ^eam 
31 as shown in F^. 9 can be decoded in which the object intra-coded indicator signal T is multiplexed into the GOV 
« ^Xti*?'!' ^ ^ configured as shown in Fig. 26 so that not the VOL header 

«,^Jif/^w ^^^^''^^^y^^' analyzes and decodes the object intra-coded indicator signal T mM- 
plexed into the GOV header 3 1c. This enables the frame skipping display control on the GOV basis 

^rS. = .""^I^TJA^ f ^'^"^ "^S- configured. It i^om^risestn correspondence with objects 

Hl'I^ ^ ''^'^^'^ ^^"^^ °* "^'"^ '^^'^^ °f decoding apparatus of the present embod- 

iment 3^ and a composition section 79 that combines the decoded image signals of the plurality of otqects 77a-77c to 

I^^^Tk"!!^^ w^o w"^® ^■^'^ as reducing the display rate of a particular 

objert by the VOP decodera 78a-78c. This enables such control as reducing the display rate in «ie ascendingorder of 
importance, when a plurality of ot)jects with the order of importance are combined into a picture. 
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[01 1 1 ] Moreover, although it is assumed that the VOP decoder of the present embodiment 3 is capable of decoding 
the coded bit stream generated by the VOP encoder of foregoing embodiment 1 . and receives and decodes the coded 
VOP bit stream 30 or 31 as illustrated in Fig. 8 or 9. this is not essential to the present invention. For example, the 
present invention can include not only the system that receives the bit stream directly from a coding apparatus and 
£ decodes it, but also a system that decodes a coded bit stream that is once encoded by the coding apparatus and then 
stored in a recording medium like DVD. This also applies to the decoding apparatus of the other embodiments. 

EMBODIMENT 4 

10 [01 1 2] The present embodiment 4 in accordance with the present invention relates to another example of the VOP 
decoder described in the foregoing embodiment 3. Specifically, the VOP decoder of the present embodiment 4 has a 
function to decode the bit stream including VOP rate information multiplexed Into the VOL header together with the VOL 
header Information on the encoder side, and to carry out the display control based on the decoded result. 
[01 1 3] Because the VOP decoder of the present embodiment 4 differs from the VOP decoder of the embodiment 3 

75 only in the structure of the header analyzer 42. only this component will be described. 

[01 1 4] Fig. 28 shows an example of a coded bit stream 81 decoded by the VOP decoder of the present embodiment 
4. The coded bit stream 81 as shown in Fig. 28 corresponds to a bit stream including VOP rate information 87 multi- 
plexed into the VOL header 30b of the coded bit stream 30 as shown in Fig. 8, which is set on the encoder side. Thus, 
the VOP rate information 87 is multiplexed into a VOL header 81b in Fig. 28. The VOP rate information is such informa- 

20 tion as 30 VOPs/second when the encoder side encodes 30 VOPs per second, for example. 

[0115] Fig. 29 is a block diagram showing an internal conf iguration of the header analyzer 42 characterizing the 
present embodiment 4. In Fig. 29. the reference numeral 83 designates a start code analyzer; 84 designates a VOL 
header analyzer; 85 designates a count obtained by counting the number of analyzed VOPs with which the start code 
Is analyzed; 86 designates a frame skip VOP controller; 87 designates VOP rate information set by the encoder; 88 des- 

25 ignates decoded VOP selector; 89 designates VOP select information; and 90 designates a VOP header analyzer. 
[01 1 6] Fig. 30 shows a configuration of the frame skip VOP controller 86 of the present embodiment 4 as shown in 
Fig. 29. In Fig. 30. the reference numeral 73 designates an object intra-coded decision section; and 91 designates a 
frame skip VOP decision section. 

[Oil 7] Next, the operation of the header analyzer 42 of the present embodiment 4 will be described. 

30 [01 1 8] Fig. 31 is a flowchart illustrating the operation of the header analyzer 42 of the present embodiment 4. 
[01 1 9] First, in the header analyzer 42 of the present embodiment 4. the start code analyzer 83 analyzes the start 
code contained in the input coded bit stream 81 (step ST27). As a result, the start code analyzer 83 supplies the bit 
stream to the VO header analyzer 59 when the analyzed start code indicates tiie VO (step ST28]. to the VOL header 
analyzer 84 when the analyzed start code indicates the VOL (step ST29). to the GOV header analyzer 61 when the ana- 

35 lyzed start code indicates the GOV (step ST30), and to the frame skip VOP controller 86 when the analyzed start code 
indicates tiie VOP. in which case, every time the start code analyzer 83 detects the VOP start code, it increments its 
counter and supplies its count 85 to the frame skip VOP controller 86 (step ST31). Here, the count 85 is reset every time 
the VOL start code Is detected. 

[0120] The VO header analyzer 59 analyzes the VO header information in the input bit stream, and supplies the bit 

40 Stream passing through tiie analysis back to the start code analyzer 83 (step ST32). 

[0121] The VOL header analyzer 84 analyzes in the bit stream tiie VOL header Information, tiie object intra-coded 
indicator signal 7' and the VOP rate information 87. and supplies tiie bit stream passing through the analysis back to 
the start code analyzer 83, tiie analyzed object intra-coded indicator signal T to the frame skip VOP controller 86, and 
the analyzed VOP rate information 87 to the decoded VOP selector 88 (step ST33). 

45 [01 22] The GOV header analyzer 61 analyzes the GOV header information in the input bit stream, and supplies the 
bit stream passing through the analysis back to the start code analyzer 83 (step ST34). 

[0123] Then, the decoded VOP selector 88 compares the coding side VOP rate information 87 fed from the VOL 
header analyzer 84 with the VOP rate information 71 set on the decoder side by a user or tiie like, and supplies the 
frame skip VOP controller 86 with the VOP select information 89 indicating tiie information on the VOP to be decoded 

so in accordance witii the compared result (step ST35). 

[0124] The VOP select information 89 will be described in more detail. Assume here that the VOP rate information 
87 fed from tiie VOL header analyzer 84 indicates 30 pieces/second, and the VOP rate information 71 set on tiie 
decoder side is 15 pieces/second. In this case, the VOP'select information 89 indicStes'tiiat' every other VOPs are to 
be analyzed. This corresponds to tiie fact tiiat tiie decoder side decodes tiie VOPs alternately when decoding tiie bit 

55 Stream encoded by tiie encoder side at a rate of 30 pieces per second. 

[01 25] Next, tiie frame skip contoller 86 cames out tiie processing shown at steps ST36 and ST37. The frame skip 

control processing will now be described togettier with tiie VOP header analysis at step ST38. 

[0126] First, as shown in Fig. 30. tiie object intra-coded decision section 73 in tiie frame sk^) VOP controller 86 
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decides the output destination of the bit stream in response to the object intra-coded indicator signal T fed from the VOL 
header analyzer 84 (step ST36). More specifically, the object intra-coded decision section 73 decides, as the output 
d^tination of the input bit stream, the frame skip VOP decision section 91 when the object intra-coded indicator signal 
7 IS ON. and the VOP header analyzer 90 when the object intra-coded indicator signal is OFF. 

5 [0127] When the object intra^roded indicator signal T is ON. the frame skip VOP decision section 91 in the frame 
skip VOP controller 86 makes a decision corresponding to st^ ST37. Specifically, the frame skip VOP decision section 
91 makes a decision as to whether the VOP to be analyzed is to be decoded or not in response to the VOP select infor- 
mation 89 and count 85. When the frame skip VOP decision section 91 decides that the VOP is to be decoded ("YES" 
at step ST37). it supplies the input bit stream to the VOP header analyzer 90. In contrast, when it decides that further 

10 analysis is unnecessary (W at step ST37). it supplies the input bit stream back to the start code analyzer 83 For 
example, when the VOP select Information 89 indicates that the VOPs to be analyzed take place at every other VOP. 
the frame skip VOP decision section 91 makes a decision that the decoding is necessary when the count 86 is an even 
number, and unnecessary when the count is an odd number. 

[01 28] The VOP header analyzer 90 analyzes the VOP header in the input bit stream, and supplies the bit stream 
15 after the analysis back to the start code analyzer 83 (step ST38). The start code analyzer 83 supplies the bit stream 43 
after the analysis to the video signal analyzer 44 (see. Fig. 18) when the analysis by the VOP header analyzer 90 has 
been completed. 

[0129] Thus, when the object intra-coded decision section 73 of the frame skip VOP controller 86 decides that the 
object intra-coded indicator signal T is OFF at step ST36, it supplies the input bit stream to the VOP header analyzer 
20 90 without passing through the frame skip VOP decision section 91 , which prevents the VOP from undergoing the frame 
skipping. This principle is the same as that of the foregoing embodiment 3. In contrast, when the object Intra-coded 
decision section 73 decides that the object intra-coded indicator signal T is ON at step ST36. the frame skip VOP deci- 
sion section 91 makes a decision as to whether the VOP to be analyzed at present has to be decoded or not In response 
to the VOP select information 89 and count 85. Then, it supplies the VOP header analyzer 90 with only the input bit 
25 stream to be decoded, thereby carrying out the VOP frame skipping. 

[0130] As described above, the present embodiment 4 operates just as the foregoing embodiment 3 except that it 
has a function to carry out the display control based on the result of decoding the bit stream including the encoder side 
VOP rate information 87 multiplexed into the VOL header information on the encoder side. In addition the present 
embodiment 4 is configured such that it analyzes the object intra-coded indicator signal T when decoding the coded bit 
stream including the object intra-coded indicator signal 7 multiplexed into the VOL header. This makes it possible when 
the object intra-coded indicator signal T is ON. that is. when a decision is made that all the VOP data are intra coded 
to c^rry out such processing as displaying the objects associated with these VOP data with frame skipping any desired 
VOPs in response to both the VOP rate information 87 set one the encoder side and the VOP rate information 71 set 
on the decoder side. 

35 [0131] Furthermore, the present embodiment 4 is configured such that it decodes the coded bit stream 81 including 
the object intra-coded indicator signal 7' and VOP rate information 87 in the VOL header. This enables simpler frame 
skip control in addition to the advantage of the foregoing embodiment 3 of being able to perform display with frame skip- 
ping any desired VOPs. This is because it is unnecessary for the present embodiment 4 to analyze the individual VOP 
headers to decode the relative time infbmiation (modulo-time base and VOP time increment) about the display times 

40 Which are set individually. 

[0132] Although It is assumed in the foregoing explanation that the decoding side receives and decodes the coded 
bit stream including the encoder side VOP rate information multiplexed into the VOL header, the present invention is not 
limited to this. For example, a coded bit stream can be decoded that has the encoder side VOP rate information multi- 
plexed into the GOV header. This is implemented by providing a GOV header analyzer 92 in the header analyze- 42 

45 with the function to decode encoder side VOP rate information 93 as shown in Fig. 32. Thus, the VOP rate information 
93 becomes tfie information indicating tiie VOP displ^ rate in the GOV. 

[0133] Furthermore, as ttie foregoing embodiment 3. the present embodiment 4 can be configured such that it han- 
• d^s a bit stiream including the object intra-coded indicator signal T encoded on every GOV basis, with offering a similar 
effect In tiiis case. In Fig. 29. not the VOL header analyzer 84 but ttie GOV header analyzer 61 has a function to ana- 
50 yze the object intra-coded indicator signal 7\ and in Fig. 32. not the VOL header analyzer 75 but the GOV header ana- 
lyzer 92 has the function to analyze the object intra<:oded indicator signal r. for example. 

[01 34] Moreover, the present embodiment 4 can achieve an advantage similar to ttiat of ttie foregoing embodiment 
3 by applying the VOP decoder of the present embodiment 4 to the system for decoding and confining a plurality of * 
objects as shown in Fig. 27 described in connection with tine embodiment 3. This holds true for the VOP decoders of 
ss other embodiments which will be described later. Thus, the following embodiments can also be applied to configure tiie 
system for decoding and combining a plurality of objects as shown in Fig. 27. 
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EMBODIMENTS 

[0135] The embodiment 5 in accordance with the present invention relates to an image decoding apparatus capa- 
ble of can-ying out decoding and displaying VOPs at random at any desired time by receiving a coded bit stream that 

5 includes in a VOL layer the object intra-coded indicator signal, and includes in a GOV layer the time code inibrmation 
representing the absolute display time of the VOP at the initial position of the GOV. Since the present embodiment 5 
differs from the decoding apparatus of the embodiment 3 in only the configuration of the header analyzer 42. only the 
configuration and operation of the header analyzer 42 will be described. Besides, in the present embodiment 5, the 
decoder will be desaibed that receives and decodes the coded bit stream 30 as shown in Fig. 8. 

10 [01 36] Fig. 33 shows a configuration of the header analyzer 42 in the embodiment 5 in accordance with the present 
Invention. In Rg. 33. the reference numeral 94 designates a start code analyzer; 95 designates a storing medium for 
storing the coded bit stream 30 transmitted from the coding side, such as a memory like a DRAM or SRAM, or a disk 
drive connected to a PC; 96 designates a VOP header analyzer; 97 designates an externally set time code; 98 desig- 
nates a frame skip controller; and 99 designates a search instruction signal. 

75 [0137] Fig. 34 shows a configuration of the frame skip controller 98 as shown in Fig. 33. In Fig. 34, the reference 
numeral 73 designates the object intra-coded decision section; 100 designates a comparator; and 101 designates a 
storing medium. 

[0138] Next, the operation of the header analyzer 42 of the present embodiment 5 will be described. 
[0139] Fig. 35 is a flowchart illustrating the operation of the header analyzer 42 of the present embodiment 5. 

20 [0140] In the header analyzer 42 of the present embodiment 5, the start code analyzer 94 analyzes the start code 
included In the input coded bit stream 30 (step ST39). The start code analyzer 94 supplies the bit sti-eam to the VO 
header analyzer 59 when the analyzed start code indicates a VO (step ST40), to the VOL header analyzer 60 when tiie 
analyzed start code indicates a VOL (step ST41), to the GOV header analyzer 61 when tiie analyzed start code indi- 
cates a GOV (step ST42). and to the VOP header analyzer 96 when the analyzed start code indicates a VOP (step 

25 ST43). Incidentally, after completing tiie analysis by tiie VOP header analyzer 96, the bit stream is supplied to the video 
signal analyzer 44. and ttie processing Is returned to the start code analysis again when the video signal analyzer com- 
pletes the analysis and decoding of the video signal of the current VOP. 

[0141] The VO header analyzer 59 analyzes tiie VO header information in the input bit stream, and supplies tiie 
start code analyzer 94 witii the bit stream after tiie analysis (step ST44). 
30 [0142] The VOL header analyzer 60 analyzes tiie VOL header information in tiie input bit stream, and supplies tiie 
start code analyzer 94 with tiie bit stream after the analysis (step ST45). In the course of this, tiie VOL header analyzer 
60 decodes tiie object intra-coded indicator signal T contained in the VOL header, and supplies it to the VOP header 
analyzer 96. 

[0143] The GOV header analyzer 61 analyzes the GOV header information in the input bit sti'eam. and supplies the 
35 start code analyzer 94 with tiie bit stream after tiie analysis (step ST46). In tiie course of this. GOV header analyzer 61 
decodes the time code 53 in tiie GOV heada information, and supplies it to the VOP header analyzer 96. 
[0144] The VOP header analyzer 96, which carries out the VOP header analysis at step ST47. comprises a struc- 
ture for achieving high rate, simple random access of the VOP disclosed in the present embodiment 5. The structure is 
implemented by the frame skip controller 98. 
40 [0145] Fig. 36 is a flowchart illustrating the processing in tiie VOP header analysis at step ST47 by the frame skip 
controller 98. Referring to Fig. 33 showing the details of the VOP header analyzer togetiier witii Figs. 34 and 36, the 
VOP random access processing will be described. 

[0146] First, as operation environments, the following conditions (1)-(4) are assumed. 

45 (1 ) The decoding and display of objects is can-led out by reading and loading the coded bit stream stored in the stor- 
ing medium 95 (sudi as a storage like a CD-ROM and DVD. a memory like a DRAM and SDRAM, and a hard disk 
drive connected to a PC). In tiiis case, the time codes are each displayed on the display screen in synchronism witii 
tiie VOP display to notify tiie user of the absolute display time of respective VOPs. The coded bit stream can be 
transferred from tiie decoder to the readable storing medium 95 through a network or broadcasting network. 

£0 (2) The user stops the decoding at any desired position. At the same time, tiie tine code also halts at the cone- 
sponding VOR The display continues showing ttie last VOP image displayed just before halting tiie decoding. It Is 
assumed tiiat tiie user wishes to extract from the bit stream a VOP image at a position before or after the stopped 
position a still picture. 

(3) The user inputs the time code of the VOP image he or she wished to extract by such a means as a command 
55 designating the time code or tiie like. The input time code thus entered becomes the externally set time code 97. 

(4) Comparing the externally set time code 97 input by the user at the foregoing stage (3) witii the time code of tiie 
currentiy stopped VOP image. If they differ from each other, the VOP image witii tiie time code matching the exter- 
nally set time code 97 is searched for and is decoded and displayed. 
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SltP ..'[If'^w^f'I: ""dergoes predictive coding using VOP images before and after its 

Si»r cj ll^'^r"* embodiment 5. however, using the ot)ject intra-coded indicator signal T and the frame skip 
cortroller 98 makes rt possible to immediately infer the VOL that is intra coded, that Is. undergone codlng wS IT 

KLuLihiJ^lH «'".d*on (1). the decoding apparatus carries out the normal decoding operation 

Assume that the decoding apparatus is in transition from the foregoing condition (1) to (2) In this state the time o«fe 

SS-timrilfanXTS'"' ''^ ^""^ ^^^^^ ^^''^^ '^'^ 

iS V<ip tlm^rcSSraSly^r^y" ""^ ^^"^ ^'^'^ ^ -^«^ 

Elf I « ^►f ^.^^ calculates the VOP time code 70 Indicating the decoded VOP absolute display time from the 
""^t '"'^'"^ ''"^ ^-^^ ^ GOV header an^er 6l7sl^ StS^ 

hLJ^I J '^^ ^^'^ absolute display time generator 66. and its calculation .iet^wi 

foTetSr" "'""'"'^'^'"''^'•■^"^^''""^^^ 

Ehe ra^^Ji!?^" <^ri«s outthe operation (3). This will provides the externally set time code 97. ena- 

bling the random access mechanism by the frame skip controller 98 

SiSi .« JfT "'"Parator 100 makes a decision as to whether the current VOP is the VOP a user 

wishes to display or not (step ST47^) by comparing the time code of the VOP the user wishes to display ttiatts fte 
«rtemally set time code 97 with the VOP time code 70 of the currently displayed VOP ' 
« ^ J ^7 ^ « the "VOP to be displayed- ("YES" at steo OT47-4) 

^ ^® displayed is previous to the current VOP or not by comparing the externally set time cod*> <37 
Zf^Tr ° '° Of the current VOP (step 8147-5). Thus, one citheZowiCl^o^res 1 1S aTd 

^theccwrse of this, thestoring medium 101 temporarily stores the VOP timecodes70prevlous^ 
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S!Ii!fJn • H'^i?^® • ^ "'^^ externally set time code 97 indicates a time subsequent to the VOP time 

code 70 in the foregoing condition (2) such as the externally set time code 97 Is 01 :00:30. and the VO? time a^e TO 

:;;;:^s?«nSi°^ ?srer^4?-er ^ 

"forwaxisearch^ and sends It with the bit stream to the start code analyzer 94(stepST4^ 

Ses tfSt^r5>^?„" I! 'S^ ^"^-^ indicator signal r is OFF ("YES" at step ST47-6). that is. when it 
^^^^^.^Jl^^Zt^^- '° ^'"^'"^^ VOPs cannot be directly 

nSfti^^. rS?„^^- *^ «^'"9- ^'^ case, the VOP time code 70 is calculated by decoding the 

modulo-tne Ijase 65 and VOP tme increment 68 of the individual VOPs through the foregoing steps ST47-1 - 47-3 a^ 

d^I^'inTs'^':. '^'^ ^' ^"^-^ vo'ps are succisi^S 



Case 2: 



"SZ voP,° in ^! uSf'^' ^^^^J!'^ i"fra-coded indicator signal T is ON (W at step ST47^). that is. when 
cfl!!- ^ M '"^ • «»"(»ralOf 100 sets ttie search instruction signal 99 at "badwart 

search and sends rt together with the bit stream to the start code analyzer 94 (step ST47-9). TOs malS Swe 
for the start code analyzer 94 to analyze the bit stream in the backwa«l direction, thereby e^bSg ^^ngTS 
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start code of the VOPs before the foregoing condition (2). 

[0161] In contrast, when the object intra-coded indicator signal 7 Is OFF ("YES" at step ST47-8), that is, when it 
indicates that "the VOPs in the VOL are subject to the predictive coding", the individual VOPs cannot be directly 
decoded because they undergo the predictive coding. In this case, the VOP time code 70 must be calculated by decod- 
5 Ing the modulo-time base 65 and VOP time increment 68 of the individual VOPs. and the image data twist be decoded 
by ascending to the VOP images that are not subjected to the prediction, that is, to the previous I- VOP (intra-coded 
VOP). and by restarting the decoding therefrom. This is handled by instructing to perform backward search by ascend- 
ing to the previous l-VOP according to the search instruction signal 99 (step ST47-10). 

[01 62] Thus, in the present embodiment 5, when the object Intra-coded indicator signal T is ON In the cases 1 and 

10 2. the start code detection of the VOPs is continued according to the search instruction signal 99. and the VOP image 
data is skipped without carrying out the video information header analysis at step ST47-1 T. 
[0163] Specifically, every time the VOP start code is detected, the following processings are iterated until the exter- 
nally set time code 97 agrees with the VOP time code 70 obtained as a result of ttie search. These processings com- 
prise the analysis of the modulo-time base and VOP time inaement of the individual VOPs: the calculation of ttie VOP 

75 time code 70 indicating tiie at)So!ute display time of tiie currentiy decoded VOP (step ST47-1 -847-3); and a decision 
making as to whetiier tfie current VOP is a VOP to be displayed or not by comparing tiie current VOP time code 70 witti 
the externally set time code 97 (step ST47-4). These processings are Iterated until the externally set time code 97 
agrees with the VOP time code 70 obtained as a result of the search. When tiie externally set time code 97 agrees witii 
the VOP time code 70 as a result of tiie search, which means that the decoding is stopped at the exact position of the 

20 VOP to be displayed, the operation of the random access is completed. 

[0164] As described above, according to the present embodiment 5, when the object intra-coded indicator signal T 
that Indicates whether all the VOPs in tiie VOL are intra coded or not is ON. that Is, when all the VOPs In ttie VOL are 
intra coded, the VOP image data Is skipped witiiout performing tiie sequential decoding of Individual VOPs based on 
the video information header analysis at step ST47-1 1 so that tiie desired VOP Image data is directly searched for and 

25 decoded. 

[0165] As a result, considering a home video according to tiie MPEG-4 compression standard, which irrtra codes 
all VOPs and stores tiiem on tiie storing medium 95. and edits a desired scene by combining them witii other object 
videos provided tiirough the Internet or by means of a CD-ROM or DVD-ROM, the decoding apparatus with the config- 
uration of the present embodiment 5 can make a high speed access to a picture at a desired time in tiie video pictures 
30 acquired, tiiereby enabling the video edition without stress. 

[0166] Furthermore, the video contents can be stored In a large capacity recording medium such as a DVD-RAM 
witii their VOPs being intra coded using ttie compression standard according to the MPEG-4, so that desired edition 
can be achieved by exploiting high speed access when producing a television program. 

[01 67] Although tiie present embodiment 5 is described by way of example of tiie coded bit sta'eam 30 including tiie 
35 object inti-a-coded indicator signal 7 multiplexed into tiie VOL header as shown In Fig. 8. in which the bit stream con- 
taining the GOV layer Including the lime code is decoded, the present invention is not limited to tills. For example, as 
for tiie coded bit stream 31 as shown in Fig. 9 that Includes the object Intra-coded Indicator signal T multiplexed into tiie 
GOV header 31c. random access to a desired VOP can be made smoothly using tiie configuration that analyzes ttie 
object intra-coded Indicator signal T by the GOV header analyzer 61 when all tiie VOP in the GOV are intra coded. 

40 

EMBODIMENTS 

[0168] In the present embodiment 6 in accordance witii the present Invention, an image decoding apparatus will be 
described which receives a coded bit stream, and can perform decoding and display by randomly designating tiie VOP 

45 at a desired time. The coded bit stream Includes In the VOL layer the object intra-coded Indicator signal T and ttie VOP 
rate information as the display rate Information indicating the display rate of ttie VOPs In the VOL. and includes in ttie 
GOV layer the time code Information representing the absolute display time of the VOP at ttie initial position of ttie GOV. 
in the present embodiment 6, since only the configuration of the header analyzer of tiie decoding apparatus differs from 
that of the embodiment 4, only tiie operation of tiie header analyzer will be described below. Besides, it is assumed in 

so the following description of the present embodiment 6 tiiat tiie coded bit sta'eam 81 as shown in Rg. 28 is input and 
decoded. 

[0169] Fig. 37 is a block diagram showing a configuration of the header analyzer 42 in the embodiment 6 In accord- 
ance vtrith the present invention. In Fig. 6. tiie refererlc^ numeral 102 designates a start code analyzer; 103*designates^ 
a decoded VOP selector: and 104 designates a VOP header analyzer. Since tiie remaining configuration is tiie same 
55 as tiiat of ttie header analyzer as shown In Rg. 29 of tiie embodiment 4. ttie description thereof is omitted here by 
assigning the same reference numerals. 

[01 70] Rg. 38 shows an internal configuration of the decoded VOP selector 103 as shown in Rg. 37. In Fig. 38. the 
reference numeral 73 designates an object intra-coded decision section; 100 designates a comparator; and 105 desig- 
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nates a VOP time code calculating section. 

Si^l ^^J!"-® "'if °^ ^"^'y^®' ^ Present embodiment 6 will be described, 

n]^ Fi3.^39 IS a flowchart illustrating the operation of header analyzer 42 of the present embodiment 6 
5 ^r.^ in I •^^[flf l!^®' ^^^'^ embodiment 6. the start code analyzer 102 analyzes the start code 

SS^eaS aSZ "T'^ ^U'''^ ^"^^^^^ supplies the brt stream to the 

w?pn.^fin«r^ L!!^^" ^"^'^^ "'^^ '^P'^^^^ VO (step ST49). to the VOLheader analyzer 84 

S an ^SSL""^ ^"f *^ ^^^^"^ 43 passing through the 

header analysis to the vKieo signal analyzer 44 which analyzes and decodes the video signal of the current VOP and 

licZ^^.:?;;,rvnp"'" T -S--- -tart c«de analyzer 102 has'a VOP counter i^ ^!n^£ 

^nX^!? ^^'^ "'"^ ^^t^'^*"^' ^ °"»P"* tl^^ The count 85 is 

,5 ^rSfsSrUoSeTdSeSS 

^° i"^'^®' ^"^'^'^^ ^° "^^'^^^ information in the input bit stream, and supplies the bit 

stream after the analysis to the start code analyzer 102 (step ST53). hh » uib uii 

hS=m o^H! ^'T^ f "f^*' ®* ^"'^^ *® information i„ the input bit stream, and supplies the 

^ T^^^^ ^Z"^^ to ttie start code analyzer 102 (step ST54). In the couise of this, the VOL header analyzer 
84 decode the object intra-coded indicator signal T and VOP rate information 87 contained in the VOL header infor- 
mation, and SLfiplies them to the decoded VOP selector 1 03. 

hS«n, 2°^ header analyzer 61 analyzes the GOV header information in the input bit stream, and supplies the 
bit stream after the analysis to the start code analyzer 102 (step ST55) w«»u« 

Sr iJ" """"^f °' ^^'y^^ ®^ GOV time code 63 contained in the GOV 

header informatron. and supplies it to the decoded VOP selector 103 

iSoH yHT '^T^^^ irrplement the high speed, simple VOP random access structure 

disclosed by the present embodiment 6 (step ST56). 

voS ^® '^'^^ embodiment 6, using the object intra-coded indicator signal 7' and the decoded 

S70 o tt,^SS ■Jrvnl'''^^ K 6, the VOL layer contains the VOP rate informatton. and the time 

codes 70 of the individual VOPs can be identified without decoding the modulo-time base and VOP time inaement 
tor S at Step STsl* 'llustrating the detail processing of the VOP random access by the decoded VOP selec- 

Lc.™!?h'^'^ ^, ^ ^"^ °^ VOP random access processing will be described. 

rniS, M ^ ''°TT L'^'^'*^ "^^'^^ embodiment 5 as the operation conditions. 

orLo^^^^^ ^ ® "^^^^ apparatus carries out the normal decoding operation in the condition (1) in 

fi^nn k'.^ ""^ '^""'^""9 ' °5 tf*® 70 of the VOP image whoSS 

d^^g IS to be halted in response to the user acUon in the condition (2) (step ST56-1). It is obtained by the following 

VOP time code 70 = GOV tine code 63 + (count 85) ^ (VOP rate information 87) 

VOP time code calculating section 105 divides the count 85 by the VOP rate information 

^:e'ii^z^o%ZnS' *° ^ ^ 

fJnfl v/r!L°' T"^^- ®® °^ °° 00 second, the count 85 is 60, and the cod- 

cndfb! ^^'^rlf " ®^ ^° pieces/second, the VOP time code is calculated as 01 hour 00 minutes 02 sec- 
onds by adding 60/30 ( = 2) seconds to the GOV time code 63. 

^f^'"^ *° P'®^®"* embodiment 6. it is unnecessary to obtain the VOP time code 70 of the VOP image 
^!".^ri^^ d««l>ng through the three steps (step ST47-1 - ST47-3) as in the foregoing embodiment 5. Instead of 
this, the Stan code analyzer 102 detects the start code of each VOR 'ana increments the VOP counter so that it can 
2L 7o"rhJI' '^'^ °" ^"^ GOV time code 63. fte ^Sp 

Sp tl^ e ,Li.f Z?hf embodiment 5 can do. Thus, it can presents the user with the 

VOP time code at the halt state in the foregoing condition (2). 

SlifL carries outthe operation in the foregoing condition (3), which will provide the exter- 

nally set time code 97 the user wishes to extract This will activate the random access structure by the decoded VOP 
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selector 103. 

[0189] More specif icaity, the comparator 100 decides first on whether the VOP at which the decoding is halted is 
the VOP the user wishes to display or not (step ST56-2) by comparing the externally set time code 97 with the VOP time 
code 70 fed from the VOP time code calculating section 105. 
5 [0190] When they agree (TES" at step ST56-2). the comparator 100 decides that the VOP is the "VOP to be dis- 
played", and candies out the analysis of the VOP header (step ST57). Othenwise ("NO" at step ST56-2). comparing the 
externally set time code 97 with the VOP time code 70 of the current VOP, it decides as to whether the VOP to be dis- 
played is before or after the cunent VOP (step ST56-3). and then makes a decision on which one of the following cases 
1 and 2 applies. 

10 

Case 1 : 

[0191] The case 1 applies when the externally set time code 97 indicates that it follows the VOP time code 70 In the 
foregoing condition (2) such as when the externally set time code 97 is 01 :00:30, and the VOP time code 70 in the fore- 
15 going condition (2) is 01 :00:10 CVES" at step ST56-3). In this case, the action to be taken is switched in response to 
the value of the object Intra-coded indicator signal T (step ST56-4). 

[0192] Thus, when the object infra-coded indicator signal 7 is ON ("NO" at step ST56-4), that is, when it indicates 
that "all the VOPs in the VOL are infra coded", the comparator 100 places the search instruction signal 99 at "forward 
search", and supplies it together witii the bit sfream to the start code analyzer 102 (step ST56-5). 

20 [0193] This enables the start code analyzer 102 to search for the VOP start code fonvard, that is, the VOP start 
code subsequent to the VOP time code 70 at which the decoding is halted in the foregoing condition (2). 
[0194] On the corrtrary. when the object infra-coded indicator signal 7' is OFF ("YES" step ST56-4). that is, when it 
indicates that the "VOPs in the VOL undergo the predictive coding", tiie individual VOPs cannot be directly decoded 
because the VOPs in the VOL are predictively coded. 

25 [0195] Accordingly, tiie VOP header analyzer 104 must carry out in the normal VOP header analysis at the next 
step ST57 substantially the same processing as that of steps ST47-1 - ST47-3 and ST47-1 1 as shown in Fig. 36 to ana- 
lyze and decode the individual VOP modulo-time base and VOP time increment, and to calculate the VOP time code 
70 of tiie current VOP at which tiie decoding is halted in order to successively decode the VOP images. Thus, the next 
VOP Is sequentially decoded in this case. 

30 

Case 2: 

[01 96] The case 2 applies when the externally set time code 97 indicates tiiat it precedes the VOP time code 70 in 
the foregoing condition (2) such as when the externally set time code 97 is 01 :00:00 and the VOP time code 70 in tiie 
35 foregoing condition (2) is 01 :00:10 ("NO" at step ST56-3). In this case, the action to be taken is switched in response to 
the value of the object infra-coded indicator signal 7' (step ST56-6). 

[0197] Thus, when the object infra-coded indicator signal 7* is ON ("NO" at step ST56-6), the comparator 100 
places the search insfruction signal 99 at "backward search", and supplies it together with the bit sfream to tiie start 
code analyzer 102 (step ST56-7). 
40 [0196] This enables the start code analyzer 102 to start analyzing the bit sfream in the reverse direction, and to 
search the VOP start code previous to the foregoing condition (2). 

[0199] On the contrary when ttie object infra-coded indicator signal 7' is OFF ("YES" step ST56-6), that is, when it 
indicates that the "VOPs in the VOL undergo tiie predictive coding", the individual VOPs cannot be directiy decoded 
because the VOPs In tiie VOL undergo tiie predictive coding. In this case, tiie Individual VOP image data must be 
45 decoded by freeing back to the VOP image that does not undergo the predictive coding, that is, to the previous l-VOP. 
and the decoding must be restarted therefrom. This is achieved by the search insfruction signal 99 that insfructs to trace 
back to the previous l-VOP with carrying out tiie reverse search (step ST56-8). 

[0200] Thus, in tiie present embodiment 6. when the object infra-coded indicator signal 7' is ON in the cases 1 and 
2, the start code detection of tiie VOPs is continued according to the search insfruction signal 99, and tiie VOP image 

so data is skipped without tiie video information header analysis at step ST57. 

[0201 ] Specifically, every time tiie VOP start code is detected, tiie following processings are iterated until the exter- 
nally set time code 97 agrees witii tiie VOP time code 70 obtained as a result of tiie search. These processings com- 
prise the calculation of tiie VOP time code 70 indicating the absolute display time 6f the^'cun-ent VOP (step ST56-1); and 
a decision making as to whether the current VOP is a VOP to be displayed or not by comparing the current VOP time 

55 code 70 witii the externally set time code 97 (step ST56-2). Then, when tiie externally set time code 97 agrees with tiie 
VOP time code 70 as a result of tiie search, which means that the decoding is stopped at the exact position of tiie VOP 
to be displayed, the operation of tiie random access is completed. 

[0202] As described above, according to the present embodiment 6, when the object infra-coded Indicator signal T 
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that indicates whether all the VOPs In the VOL are intra coded or not is ON. that is. when all the VOPs in the VOL are 
intra coded, the sequential VOP decoding is skipped without performing the VOP header analysis for individual VOPs 
at step ST57. This enables the desired VOP image data to be directly searched for and decoded. 

. . present embodiment 6, the VOP time code 70 is determined using the GOV time code 

s 63 «rtiich IS the time code of the initial VOP of the GOV. the count 85 fed from the start code analyzer 1 02 and the VOP 
rate information 87 on the coding side. This obviates the need for decoding the modulo-time base or VOP time incre- 
ment information for each VOP. which means that random access can be achieved by calculating in advance the 
number of VOPs to be skipped from the externally set time code 97. Thus, the present embodiment 6 can dispense with 
the need for successively calculating the display time of each VOP to make the decision at steps ST47-1 - ST47-3 of 

10 Fig. 36 as in the foregoing embodiment 5. This enables the random access faster than that of the embodiment 5 In 
brief, high-speed random access is implemented because the individual VOP time code can be identified from the VOP 
rateirrformation without calculating the display time of each VOP with performing the successive VOP header analysis 
n^l exanple. considering a home video according to the MPEG-4 compression standard, which intra codes 
all VOPs and stores them on the storing medium 95 and edits a desired scene by combining them with other object vid- 

15 eos provided through the Internet or by means of a CD-ROM or DVD-ROM. the decoding apparatus with the configura- 
tion of the present en*odiment can make a high speed access to a picture at a desired time in the video pictures 
acquired, thereby enabling the video edition without stress. Furthennore. the video contents can be stored in a large 
capacity recording medium such as DVD-RAM with their VOPs being intra coded by the compression standard accord- 
ing to the IVIPEG-4. so that desired edition can be achieved by making high speed access when producing a television 
20 program. 

[0205] Although the present embodiment 6 is described by way of example of the coded bit stream 81 as shown in 
*u Z^'^ rndudes the object intra-coded indicator signal T and VOP rate information 87 multiplexed into 

the VOL header 81 b. but also includes in the GOV header 81 c the GOV tine code 63 indicating the absolute display time 
of the inrtial VOP in the GOV. the present invention is not limited to this. For example, a coded bit stream (not shown) 
25 can be decoded which includes In the GOV header not only the GOV time code 63. but also the object intra-coded indi- 
cator signal T and VOP rate information 87. This is impjemented by providing the GOV header analyzer 61 as shown 
in Rg. 37 with the decoding function of the object intra-coded indicator signal T and VOP rate information 87 in addition 
to the decoding function of the GOV time code 63. 

30 EMBODIMENT 7 

10206] In the present embodiment 7 In accordance with the present invention, a VOP decoder will be described for 
decoding the coded bit stream generated by the VOP encoder of the foregoing embodiment 2. 
[0207] Thus, the VOP decoder of the present embodiment 7 is characterized in that it receives the coded bit stream 
35 39 as shown in Rg. 15. decodes from the coded bit stream 39 the object intra-coded indicator signal 7\ the display time 
multiplex Identification information 34 and the time codes 35 of Individual VOPs described in the embodiment 2 and 
controls the decoding and display of the VOPs in accoixiance with these values. 

[0208] The VOP decoder in the present embodiment 7 has substantially the same configuration as the VOP 
decoder desatoed in the embodiment 6, except for the header analyzer 42. Accordingly, only the header analyzer 42 
40 of the present embodiment 7 will be described below. 

[0209] Rg. 41 is a block diagram showing an internal configuration of the header analyzer 42 in the present embod- 
iment 7. In Rg. 41, the reference numeral 106 designates a VOL header analyzer; and 107 designates a decoded VOP 
setector. Since the remaining configuration is the same as that of the header analyzer 42 of the embodiment 6 as shown 
m Rg. 37, the description thereof is omitted here by assigning the same reference numerals. 

[021 0] Rg. 42 is a block diagram showing an internal configuration of the decoded VOP selector 1 07 of the present 
embodiment 7 as shown in Rg. 41 . In Rg. 42. the reference numeral 73 designates an object intra-coded decisfon sec- 
tion; 100 designates a comparator: arid 108 designates a VOP time code holder. 
[021 1] The operation of the header analyzer 42 of the present embodiment 7 will now be described. 
[^ 2] Rg. 43 is a flowchart illustrating the operation off the header analyzer 42 of the present embodiment 7 
[021 3] In the header analyzer 42 of the present embodiment 7. the start code analyzer 1 02 analyzes the start code 
contained in the input coded bit stream 39. first (step ST58). The start code analyzer 102 supplies the bit stream to the 
VO header analyzer 59 when the analyzed start code indicates a VO (step ST59): to the VOL header analyzer 106 
when the analyzed start code indicates a VOL (step ST60); to the GOV header analyzer 61 when the analyzedT stert 
^o^^l^^oates the GOV (step ST61): and to the decoded VOP selector 107 when the analyzed start code indicates the 
55 vup (step ST62). 

[021 4] Incidentally, when the VOP header analyzer 104 completes Its analysis, the start code analyzer 1 02 supplies 
the brt stream 43 to the video signal analyzer 44. so that the video signal analyzer 44 cames out the analysis and 
decoding of the video signal of the current VOP. and returns the processing to the start code analysis, again. The start 
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code analyzer 102 Includes a VOP counter that Increments the VOP count every time the VOP start code Is detected,' 
and supplies the count 85 to the decoded VOP selector 1 07. It Is assumed here that the VOP counter is reset every time 
the VOL start code is detected. 

[0215] The VO header analyzer 59 analyzes VO header Information in the input bit stream, and supplies the bit 
5 stream after the analysis back to the start code analyzer 1 02 (step ST63). 

[021 6] The VOL header analyzer 106 analyzes the VOL header information in the input bit stream, and supplies the 
bit stream after the analysis back to the start code analyzer 102 (step ST64). 

[0217] In the course of this, the VOL header analyzer 106 decodes the object Intra-coded Indicator signal T. the 
display time multiplex identification information 34 and the time codes 35, which are contained in the VOL header infbr- 

10 mation as shown in Fig. 15. and supplies them to the decoded VOP selector 107. 

[0218] As described in the foregoing embodiment 2. the display time multiplex Identification information 34 is 
decoded only when the object Intra-coded Indicator signal T is ON. that is, only when It indicates that ail the VOPs con- 
tained In the VOL unit is intra-coded, and the time codes 35 are decoded only when the display time multiplex Identifi- 
cation infomnatlon 34 Is also ON. Assume here tiiat both the object Intra-coded Indicator signal 7* and display time 

75 multiplex identification information 34 are ON, and the time codes 35 of all the VOPs in the VOL are decoded by the 
VOL header analyzer 1 06. 

[0219] The GOV header analyzer 61 analyzes the GOV header Information in the input bit stream, and supplies the 
bit sti-eam after tiie analysis back to tiie start code analyzer 102 (step ST65). 

[0220] In the course of this, altiiough the GOV header analyzer 61 decodes the GOV time code 63 contained in the 
20 GOV header information, the present embodiment 7 does not use the GOV time code information. 

[0221 ] The decoded VOP selector 1 07. which has the high speed, simple and random access structure of tiie VOP 
disclosed in tiie present embodiment 7, selects the VOP to be decoded (step ST66). The random access mechanism 
of the present embodiment 7 is characterized in that it can obtain the VOP time codes to be compared with the exter- 
nally set time code 97 by tiie comparator 100 without any calculation. 
25 [0222] Fig. 44 is a flowchart illustrating tiie processing in detail of tiie VOP random access structure based on tiie 
decoded VOP selection at step ST66 by the decoded VOP selector 107. 

[0223] With reference to Figs. 42 and 44 mainly, the operation of tiie VOP random access processing will be 
desaibed. In which the foregoing conditions (1)-{4) described in the embodiment 5 are also assumed as the operation 
conditions. 

30 [0224] First, tiie time codes 35 of all tiie VOPs in tiie VOL decoded by the VOL header analyzer 1 06 are stored in 
the VOP time code holder 108 in the VOP selector 107 to be retained until tiie decoding of the VOL is completed (step 
ST66-1). In the condition (1), the decoding apparatus cames out normal decoding operation, here. 
[0225] Assume tiie instant at which tiie decoding apparatus makes a transition from tiie condition (1) to condition 
(2). 

35 [0226] In response to the transition from tiie condition (1 ) to condition (2) by the user operation, the VOP time code 
holder 108 in the decoded VOP selector 107 receives or generates a read command (not shown) for reading the time 
code 35 of tiie VOP image pointed by tiie count 85 at the ti-ansrtion. 

[0227] In response to this, tiie VOP time code holder 108 reads as tiie VOP time code 70 the VOP pointed by tiie 
count 85 fed from the start code analyzer 102 at the instant of tiie transition from the condition (l) to condition (2), tiiat 
40 is, tiie time code 35 of the VOP image at the time the decoding is to be halted in accordance with the condition (2). and 
supplies the VOP time code 70 to the comparator 100 (step ST66-2). 

[0228] In this way, ttie foregoing structure can identify tiie VOP time code 70 at the time the decoding is to be halted 
in the condition (2) only from the count 85 fed from tiie start code analyzer 102 without carrying out any analysis of tiie 
VOP header or any calculation. Thus, the VOP time code 70 in the stop condition (2) is presented to the user. 
45 [0229] Next, when the user carries out the condition (3), this will provide the externally set time code 97 to the com- 
parator 100, and activate the random access sti-ucture by the decoded VOP selector 107. 

[0230] Although in ttie example above, the VOP time code holder 1 08 is described such that it supplies the compa- 
rator 100 with the time code 35 of the VOP image pointed by the count 85 fed at ttie ti^ansition to the condition (2) as 
the VOP time code 70, this Is not essential. For example. The VOP time code holder 108 can always supply the com- 

50 parator 1 00 witii the time code 35 of the VOP Image, which is pointed by the count 85 constantly fed from ttie start code 
analyzer 102, as the VOP time code 70. However, in the latter case, the comparator 100 must be configured such that 
it implements the random access structure using the VOP time code 70 fed at the Instant of the transition to the condi- 
tion (2) and tiie externally set time'codd 9Tfed by tiie operation of the condition (3). In brief, it IS enough for tiie randoi^ ' 
access structure to operate such tiiat it utilizes among the time codes 35 stored in tiie VOP time code holder 108 the 

55 VOP time code 70 at the transition to tiie condition (2) and tiie externally set time code 97. 

[0231] More spedfically. the conparator 100 first makes a decision as to whether the cun'ent VOP Is the VOP the 
user wishes to display or not (step ST66-3) by comparing the externally set time code 97 with tiie VOP time code 70 of 
the current VOP which is fed from tiie VOP time code holder 108 and Uikes place at the time the decoding is halted in 
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accordance with the condition (2). 

.h!!T,np ^l^'^w^^"^ l^' """^ ^^'^^ ^"'^ 70 of the current VOP ("YES" step 

L CT.^'^^'^^ *® "^^'^ *° cS^Aayed'. followed by the VOP header analysis of the VOP to be dS 

VOP rS« StS^ "^"^"^'^ ^""^ code 97 v«th the VOP time code 70 Sf L cu^ent 

VOP (Step ST66-4) . Thus, one of the following two cases 1 and 2 is decided. 

Case1: 

TO in^ip J^L^V applies when the externally set time code 97 indicates a time subsequent to the VOP time code 
70 in me foregoing condition (2) such as the externally set time code 97 is 01 .00:30. and the VOP time code 70 in the 

^Si^*s;riT7°ssTre^^ 

[0234] More specifically, when the object intra-coded indicator signal 7' is ON ("NO" at step ST66-5) that is when 
rt indicates that all the VOPs in the VOL are intra coded", the comparator 1 00 sets the search inslrucuin s^gniS to 
fooArard search . and sends it with the bit stream to the start code analyzer 102 (step ST66-6) Thus the stert code 

[^35] In contrast, when the object intra-coded indicator signal T is OFF ("YES" at step ST66-5) that is when it 

decoded because they undergo the predictive coding. ' 
10236] Accordingly, as in the foregoing embodiment 6. the VOP header analyzer 104 must carry out the processina 

Srt" "'"^ ^'■''■^ ■ """^ ^^'^'-^ ' ^ '^^'^ ^'9- 36 in the normal VOP he^r^Tysfe 
vo? ! rn^,« ^ ^ I' ^""^ "^"■^^ '""^ r^odulo-time base and VOP time increment of the individual 

^ ^hIT'^ ''^^ "^3^ ^"^ 70 Of the cuirent VOP at which 

the decoding is halted. Thus, in this case, the subsequent VOPs are sequentially decoded 



Case 2: 



45 



SO 



55 



I?S?«,nH?«® ^® ,f ^^'^ *® externally set time code 97 indicates a time before the VOP time code 70 

Si 7- S?66-5 " '■^^'^"^^ *° °* "'^ intra^oded indicator sig- 

I^S c.»=^°'^ specifically, vrtien the object intra-coded indicator signal T is ON ("NO" at step ST66-7). the compara- 
Ser^O?!it ""'"^ ^ ^* 

II^LhJUI^^ "iT^"'!! *lf ^"^'^'^^ ♦° "^rt sfr^a-" «ie backwa«J direction. 

rn^LT ^ searching for the start code of the VOPs previous to the foregoing condition (2) 

[0240] In contrast, when the object intra-coded indicator signal 7 is OFF ("YES" at step ST66-7) that is when it 

TJSS ; t^r^eTe '° ^^"'^^'^^ "^^SIT^;"^ 

h™ 1^ 2 I L continued to the image data successively. Specifically, the decoding must 

be restarted therefrom This is handled by instructing to perform the backward search by ascending to the prevh^ish 
VOP using the search instruction signal 99 (step ST66-9) previous i 

VOP^'^'illST,^"* embodiment 7. when the object intra-coded indicator signal T is ON in the cases 1 and 
cidnnln r T according to the search instruction signal 99, and the VOP image data is 

"^"^'"^ ^^""^^ ^"^'ys's ^* ST57 as in the embodiment 6 8 « 

Si lo x/Apc"'"T u^". '^.^ ''T^"' embodiment 7. because the VOP time code holder 108 stores the time codes 35 
decldTno o?2 cu^L Sni ^""^ '""''^ "^"^^ '^''^ *^ ST66-1 until the 

th^S fimf^^ hIh ^''^ ^"^ °P^'««°" *e condition (2). 

70^J^ ItL^ w h code 35 of the VOP pointed by the current count 85 as the VOP tme code 

*i wi^ T 3 ^ ®f *° "^^^^^ is a VOP to be displayed or not by comparing 

rr?etSS!97™^Tlf'"^^^^ 

cf « ^ '^^ o* *e search. Then, when the eMernally 

.ht vnp t ^^'^ '° ^ ^''^ "^eans that t^e decodi' ^S^s « 

the VOP to be displayed, the operation of the random access is completed 

(CG43] '*fdesCTibed above. accoRling to the present embodimert 7, when the olflecti 

1 iij^:!^2 * T-!!*?:^^'^ ^'^ "^^^ that is. When all the VoS inS VOl! 

are intra coded, the desired VOP mage data is directly searched for and decoded. This is because the VOP header 
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analysis for respective VOPs at step ST67 can be omitted, and hence It is unnecessary to canry out the sequential VOP 
decoding. 

[0244] Furthermore, the present embodiment 7 is configured such that it directly decodes the time codes 35 in the 
VOPs from the VOL header, and stores them In the VOP time code holder 1 08 so that they are read in accordance with 

5 the count 85 fed from the start code analyzer 102. This makes it possible to dispense with the need for decoding the 
information about the modulo-time base and VOP time increment, and hence the decoder does not require any calcu- 
lation structure. Thus, the VOP to be decoded can be identified only by comparing the externally set time code 97 with 
each of the time codes 35 stored. This offers an advantage of being able to implement a very high speed random 
access that Is faster than those of the embodiments 5 and 6. 

10 [0245] For example, considering a home video according to the MPEG-4 connpression standard, which intra codes 
all VOPs and stores them in the storing medium 95. and edits a desired scene by combining them with other object vid- 
eos provided through the Internet or a CD-ROM or DVD-ROM, the decoding apparatus with the configuration of the 
present embodiment can make a high speed access to a picture at a desired time in the video pictures acquired, 
thereby enabling the video edition without stress. Furthermore, the video contents can be stored in a large capacity 

75 recording medium such as a DVD-RAM with their VOPs being intra coded by the compression standard according to 
the MPEO-4. so that desired edition can be achieved with making high speed access to produce a television program. 
[0246] Although the present embodiment 7 is described by way of example of decoding the coded bit stream 39 
including in the VOL header the object intra-coded indicator signal 7. display time multiplex identification information 34 
and time codes 35 as shown In Fig. 15, the present invention is not limited to this. For example, the same concept is 

20 applicable to the VOP decoder for decoding the coded bit stream 40 or 41 as shown in Rg. 16 or 17. 

[0247] For exanple, because the VOP time code contained in the GOV is multiplexed for each GOV, It is enough for 
the VOP decoder for decoding the coded bit stream 40 as shown in Fig. 16 to be configured such that the VOL header 
analyzer 1 06 decodes only the object intra-coded indicator signal 7\ and the GOV header analyzer 61 decodes the dis- 
play time multiplex identification Information 34 and time codes 35 In response to the object Intra-coded indicator signal 

25 7*. In this case, as for the GOV Including the display time multiplex identification information 34 which is ON. the high 
speed random access can be implemented for all the VOPs In the GOV. 

[0248] As for the VOP decoder for decoding the coded bit stream 40 as shown In Fig. 17, it can be configured such 
that the GOV header analyzer 61 decodes the object Intra-coded Indicator signal 7\ display time multiplex identification 
infonnation 34 and time codes 35, so that the random access function can be defined for each GOV independently. 

30 [0249] Although the foregoing embodiments 1 -7 desalbe the image coding apparatus or image decoding appara- 
tus according to the MPEG-4 that defines the coded (decoded) images in the form of the object-based VOPs. and codes 
the images on an object by object basis, the present Invention is not limited to this. For example. It is applicable to the 
Image coding apparatus, Image coding method. Image decoding apparatus and image decoding method according to 
the MPEG-1 or MPEG-2 that does not have the concept of the object or VOR In this case, coded images at respective 

35 times or Image frames in a television signal, which constitute a moving picture sequence, correspond to the VOPs in 
the foregoing embodiments 1-5. Thus, replacing the VOPs by the coded images or image frames makes It possible to 
handle them in the same manner as In the embodiments 1-7. 

[0250] For example, the MPEQ-1 or MPEG-2 reserves a user data area which allows a user to define data freely, 
or bit fields for future functional extension. Thus, defining the syntax according to the present invention In these data 

40 areas can improve the function of the random access or frame skip control. 

[0251] Although In the foregoing embodiments 1-7. the object Intra-coded indicator signal 7' is described as the 
information indicating whether all the VOPs Included in the VOL- or GOV-based moving picture sequence according to 
the MPEG-4 are intra coded or not, the present invention is not limited to the VOL- or GOV-based moving picture 
sequence. For example, as for the VOPs that constitute any units of the moving picture sequence, or defines the moving 

45 picture sequence, the object intra-coded indicator signal 7 can serve as information indicating whether all the VOPs 
included In the moving picture sequence based on the units other than the VOL or GOV are intra coded or not. This 
holds true when the VOPs are replaced by the coded images or image picture frames. 

INDUSTRIAL APPLICABILITY 

so 

[0252] As describe above, the image coding apparatus and Image coding method are based on the MPEG-4, and 
are suitable for coding images on an object by object basis. 

[0253] Furthermore, the image decoding apparatus and Image'decdding method according to the present invention 
are also based on the MPEG-4. and are suitable for decoding the coded bit stream in which the images are coded on 
55 the object by object basis. 
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Claims 



1 . An image decoding apparatus comprising: 

T™^®' foranalyzing. in a coded bit stream, intra-coded indicator inibrmation indicating whether all images 
m a moving picture sequence are Intra coded or not; and 

a decoder for decoding images contained in the mamg picture sequence in response to the intra-coded indi- 
cator informaton analyzed by said analyzer. «»-wu«»u imi 



10 2. 



4. 



The image decoding apparatus according to claim 1. wherein the moving picture sequence Is a video object layer 
consisting of nroving image objects of given shapes. 

apparatus accoiding to claim 1 . wherein the moving picture sequence is a video object plane 
group constituting a video object layer consisting of moving image objects of given shapes. 

.li^!!^^L^.^'1L"w^'^*"^^"^''''"^*°'''^'" said decoder decodes the images in the moving pic- 

ture sequencewith decimating them in response to the intra-coded indicator infomiation and display rate informa- 
tion designated on the image decoding apparatus side. 

The image decoding apparatus according to claim 1. wherein said analyzer analyzes, in the coded bit stream cod- 
ing side display rate information, and identifies images to be decoded in response to the coding side display rate 
information ^analyzed and to display rate Information designated on the image decoding apparatus ^de and 
where-n said decoder decodes the images contained in the moving picture sequence Jh d^imating ther^ b 
response to the intra-coded indicator information and display time information about the images to be decoded. 

^V^^^J^"^ apparatus according to claim 1 . wherein said decoder decodes, in response to the intra-coded 
Sff K * T^^°"« cteplay time information designated on the image decoding apparatus side, an image indi- 
cated by the display time information designated on the image decoding apparatus side. 

7. The image decoding apparatus according to claim 1 . wherein said analyzer analyzes. In the coded bit stream cod- 
ing s^e d^lay rate information and display time information of images contained in the moving picture sequence 

TJZ TJ"^^^- T'!^'^ '^"^"^ *° '^'^ information and the display time iSmatio,; 
analyzed, arxl wheran said decoder decodes, in response to the infrared indicator information, to the dlilay 

i!!!f«?"™Jl°"^ ^ '"^^ f° ^ ^ *° ^'^P'^y information designated on the image decoding 

apparatus side, the images designated by tiie display time information on the image decoding appar^ sid" 

8. The image decoding apparatus according to claim 1 . wherein said analyzer analyzes in the coded bit stream when 
the intra-coded indicator infomiation obtained as a result of analysis indicates that all images contained in ttie mov- 
2^'^'^ ^^"^l ^ '"^^ "^'^^^ '^"'**P'^ identification information indicating whetiier display 
^llTTT f , *® "^"^ sequence are multiplexed or not. and analyzes 

conteined in the moving pKrture sequence Is multiplexed, the display time information of all the images contained 
n the moving picture sequence on a basis of each moving picture sequence, and wherein said decoder decodes 

®" ,^.f'™9e decoding ap^^^^ 1. wherein said decoder decodes, in responsetothe intra-coded 

.nd^tor information, display time information and display time information designated on the image decoding 

so *rom among the images contained in ttie moving picture sequence. ■»=hm»«us6»8 

1 a An image decoding method comprising the steps of: 

analyzing, in a coded bit stream, imra-coded indicata information indicating whether all images contained in a 
55 moving picture sequence are intra coded or not; and a^w^iiwineaina 

deaxJing ttie images contained in the moving picture sequence in response to the intra-coded indicator infor- 
rnation. 
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1 1 . The irage decoding method according to daim 10, wherein the decoding step decodes the images in the moving 
picture sequence with decimating them in response to the intra-coded indicator information and display rate infor- 
mation designated on the decoding side. 

5 12. The image decoding method according to claim 10, wherein the analyzing step analyzes, in the coded bit stream, 
coding side display rate information, and identifies display time information of images to be decoded from the cod- 
ing side display rate information analyzed and from display rate information on the decoding side, and wherein the 
decoding step decodes the images contained in the moving picture sequence with decimating them in response to 
the intra-ooded indicator information and the display time information of the images to be decoded. 

JO 

13. The image decoding method according to claim 10. wherein the decoding step decodes, in response to the intra- 
coded indicator information and display time information designated on the decoding side, images indicated by the 
display time information designated on the decoding side. 

15 14. The Image decoding method according to claim 10, wherein the analyzing step analyzes, in the coded bit stream, 
coding side display rate information and display time information of the images contained in the moving picture 
sequence, and identifies images to be decoded in response to the display rate information and the display time 
information analyzed, and wherein tiie decoding step decodes the images indicated by display time information 
designated on the decoding side in response to the intra-coded indicator information, to the display time informa- 

20 tlon of the images to be decoded and to the display time information designated on the decoding side. 

15. The image decoding method according to claim 10. wherein the analyzing step analyzes, in the coded bit stream, 
when the intra-coded indicator information obtained as a result of analysis indicates that all images contained in the 
moving picture sequence are intra coded, display time multiplex identification Information indicating whether display 

25 time information of all the images contained in the moving picture sequence are multiplexed or not. and analyzes, 
when the display time multiplex Identification information indicates that the display time information of all tiie images 
contained in the moving picture sequence Is multiplexed, the display time information of all the images contained 
in tiie moving picture sequence on a basis of each moving picture sequence, and wherein tiie decoding step 
decodes the images contained in the moving picture se(:|uence in response to the Intra-coded indicator information 

30 and the display time information. 

16. The image decoding method according to claim 10. wherein the decoding step decodes, in response to the intra- 
coded indicator information, to display time information and to display time information designated on an image 
decoding apparatus side, images indicated by the display time information designated on tiie Image decoding 

35 apparatus side from among tiie images contained in the moving picture sequence. 

17. An image coding apparatus comprising: 

an encoder for coding images contained in a moving picture sequence in response to intra-coding instruction 
40 information indicating whether all the Images contained in the moving picture sequence are to be intra coded 

or not; and 

a multiplexer for multiplexing, into an image coded signal encoded by said encoder, intra-coded indicator infor- 
mation indicating whether all tiie images contained in the moving picture sequence are intra coded or not 

45 18. The image coding apparatus according to daim 17, wherein said multiplexer multiplexes for each moving picture 
sequence, when the intra-coded indicator information indicates that all the images contained in the moving picture 
sequence are to be intra coded, display time multiplex identification information that indicates whether display time 
information of all the images contained in the moving picture sequence is to be multiplexed or not. and multiplexes 
for each moving picture sequence, when the display time multiplex identification information indicates tiiat the dis- 

50 play time information of all the images contained in the moving picture sequence Is to be multiplexed, tiie display 
time information of all ttie images contained in the moving picture sequence. 

19. An image coding ^thod comprising tiie steps of : 

55 encoding images contained in a moving picture sequence in response to intra-coding instruction information 

instructing whetiier ail the inages contained in tiie moving picture sequence are to be intra coded or not; and 
multiplexing, into an encoded image coded signal, intra-coded indicator infomnation indicating whether all the 
images contained in tiie moving picture sequence are intra coded or not 
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